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ABSTRACT 

Because of the active interest of English teachers in 
standardized tests and the increased use of such tests to measure 
student performance, the emphasis section of this issue of "The 
English Record" contains articles addressing this ^subject from 
several perspectives. A report of a survey on standardized testing in 
New York State sets the scene, demonstrating that English teachers 
feel a need for test information, and pointing up the necessity for 
educating the general public in the proper use of test scores. The 
articles that follow define terras used in testing and' discuss the 
issues. Qu.'^stions are raised about some of the tests in wide use 
throughout the state of N^ew York, and several articles offer : 
alternatives to traditional ways of evaluating reading and writing. 
The emphasis section concludes with a recent sources bibliography on 
measuring growth in Englisfi. The general articles contained in this 
issue discuss the heterogeneous grouping of high school students, the 
various uses of the clo;^e technique in the teaching of English as a 
second language, Robert Frost's "The Road Not Taken," the development 
of a competency-based English curriculum in kindergarten through 
grade twelve, and the ^advantages of using improvisation in the 
English "class. (RB) i 
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At thus liiuc of iIk >c»u icmlIij'is bcco'mt ,uixioui> «il)oiu e\«Uuaiing 
llu'ii woik, \hm\ of us look M mt fiiuil letting pciiod as a means of 
tvakuitmtj what .siiukius have doiic. riu answci to the question, "Can 
we find out what\s in someone's head?" remains, '*\Ve can't." 

Ihi h}il)hasis stttion this month has been assembled b> The 
Rvt ouLs AsstK late Kihtoi , Chai ivb Coopei , and deals with the problems 
of evaluation and testing. We are paitieularl> pioud of this section 
Inxaust It upie.sentsa uidi lange of thought on themattci and should 
help to clarify (or start) thinking on the subject. 

I am \ei\ pleased about the quality and quantity of manuscripts I 
lecene. K.uii goes thiough seveial caieful readings before being 
atctpienl ui iLjetteiL If the journal weiea monthly instead of a quarterly, 
then ue tould aicept moie of them. Since this is not so, many excellent 
inamiscnpts aie sent baik to the uiiters. Mainiscripts chosen for 
publication aie not oidy of high quality but also are timely. Please do 
keep Mibmuting thosi manuscripts. I am particulaily inteiestetl in see 
lug moie aitu les fiom elenientaiy schbol teacheis. fime, of course, isa 
pioblem. but sunmier is coming. 

Lastly, one leads a gieat deal these days about going "back to 
basRs." What doyou think? Is theiea movement growing in New York 
Stale foi this? I would likt tosee thieeor foui ai tides in the fall issueon 
this subject. If it intiigues you. then why not write about it? 
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INTRODUCTION 



High 1)11 ilu a.i^tiuLi ol ilcms of .iLlivt iiucit.sl U) EiiglislT icadicrj) is 
iIk iiutlu i)f sl.iiKLudimI Usls, llicii piuliki.niuij and iIrii iiiusliiuuiii- 
iiig lok' in Knglish aliRaiiuii. Maii> icachcis arc asking uluthci the 
accckiaiiiig ust of such itsls isacct)iiinaiiictl h> agciicial uiKlciijtaiuiing 
of the sliciigihs autl hiiiiialioiis uf the icsit.saml h> ackai pciccptiun uf 
ihcir piopcT lolc in Knglish instiiiciion and cvahiaiion. 

Akii to the ciuc'bijoni) English tcachci.s arc raising, the New Voik 
State English Cuiincd appointcil a Committee un theUscandMisuscuf 
Standaidi/ed Tests. I'he u>iiiinittee'i> work has included sponsuiing a 
slaleu ide sui\c> to dctciiiiinc what English teaclicis knou and how tlicv 
kel about staiidaitli/ed tests as well as huu tcachcis use tlicui, studying 
ways of disseinin.iting test inforiiiatiun lu incmbeis of NYSEC, «nd 
eoopiiating with the National Council of Tcachcis of English m tfie 
ticvolopinent of policy concerning standardi/ed tests. 

In this issue of The EnglLsh Reioul, the committee presents a gioup 
of aitiiks that atldiess the subject from scveial pcrspectncs. A lepoi t of 
the sui\e\ sponsoicdby tlu coinmittet ;icb uic5ccuc,dc'munstratnig that 
English teaehcis feel a need foi test infoimation anil ponitmg up the 
necessity foi cdue.itiiig the gciieial public legaiding the proper intcr- 
pieiaiion of test scoics. Ehe ai tides that follow define terms used in 
lesling and discuss the issues. Questions aie laised about some of the 
tests in wide use thioughout the state. Several ai ticks offci fresh, 
pro\ocati\e alternatives to traditional ways of evaluatnig reading and 
writing. A "recent sources" bibliography closes the series. 

The mcmbcis of NYSEC's staiidardi/ed testing committee are: 

Charles R. Cooper 

Slate Ihiiversity of New Yoik at Buffalo 
Morris Finder 

State University of New York at Albany 
La Ruth Gray 

Isaac E. Young Junioi High School 
New R(x:helle..\ew York 

Robert I. Infantino 

Committee Reseaichei 

Slate University of New^ York at Buffalo 

It has been a ptisonal pleasure to bi associated with the coimiiittet 
in this iinpoit.int i ffoit. .ind I w ish u>c\pitssiny ijiiiccic apprecia.ion to 
its ineinbciJi foi the ume. cffoit, and valuable insights they have con- 
tributed so generously to our common task. 

Ouida H. Clapp 
Buffalo Public Schools 





Results of the NYSEC 
Survey on Testing 

by Robert Infanlino 

In Ma\ uf 197 1 a siir\t> w.is coiuliRicd among nearly 1000 ranuoin- 
\) sclci tai English it.Rlicts .itioss Xcw VoikSi.nc loastcitain turreni 
pniclitcs ni st.tnd.tuh/cd testing .nui lio\v English tcachcis felt .ibout 
tluvsc piactitcs. 1 ht Nu\ York St.hc English Coinicil (XYSEC) Coin- 
nuittt on ilu Tsts and Abnsis of Staniiaidi/.cd Testing sponsored the 
suivt and itsponsis utrc col kx led fionvj09 English teat liers/i'h is ar- 
ticle will present some of the findings of that survey- 

Tsing tin ttnnpiHei resources of the Bureau of Educational Data 
S> stems (BEDS) of the New York State Eclutation Department, a lan 
doni^ampk of 983 English ttathei^ was compiled, riiis sample includ- 
ed tc.ieluis fioni all publii school systems in the Slate, including the 
New \uik Cat> tiachcis. Of the 509 teachers who lesponded (51.6%), 
ilicie were 197 \ahu. useable surveys, a retinn of 50.5^. These included 
\yi who uiintificd themselves as teachers in eil> sehools, 213 in subur- 
ban schools, and 100 m ruial schools. The figuies do not always equal 
'197 since some lespondents omitted some items- 

I lieu^ ucK li95 seniui high school teachers (grades 9-12) and 171 
junioi Ingh^tn nnddlc school leacheis (grades 6-9). Twenty-eight (28) 
taught m othei siuiations which included teachers of giadcs 7-12 or 
sonu te.tehcis ui special Lmgn.igc alts piogi.ims in elemental y schools. 
A \\ ide lange of te.iehing experience was repiescntcd by th*. icspondenis, 
with 69 being m then fiisloi si com! year ofjuiehing and w ith 95 having 
mcjic than fifteen yeais as teachers- 

The survey itself asked teachers to respond to 37 items concerned 
with then knowledge uf euiieiu testing piaetices in dieir own school 
sv stems and huu these piaetices affected theii English classrooms. 
Testing was defined as either standardized, i.e., scored on the basis of a 
set of norms for a large population (like the SAT), or externally 
picpaied, I.e. prepared by someone other than the teacher of the course 
(like the Regents Comprehensive English Examination)- 

The second part of the survey included 27 aililudinal items on 
which icaehers were asked to indicate their feelings about testing and 
some of us ramifications such, as aeeoumabiHiy, gain in pupil pcrfor 
mancc as a measure of teacher effectiveness, and cullur.il bias in stan- 
daidi/ed tcst.s. Ciimpletc residts of this survey cannot he printed here but 

hi available through Univeisity Miei films and possibly through 
NYSEC. What follows is a limited repuiling of some of the data 
collected, vvith comments about die significance of some of the 
lesponses. 
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Theic were 127 icachm who b.ml ilut the bcurc^ pupiLs rccchc un 
sumUidi/.al loisucic a\aiLibk lu the icachcis al iicai l> .ui> iiiiic.Oiil> 
2 said ihai scuio ucic iiui a\ailablc lu teachers at all, while others in- 
dicated that an adiniiiistratoi or co'uii.seloi must gnc pciinissiuii to see 
the scores. Vet uiil> 291 of the teachers stated that the> feel eumpetent 
enough tu inteipret test scoies theni.selvesand unl> 173 have e\ei attend- 
'cd meetings oi workshops intended tu aeijuaint teacheis with the use 
and interpretation of standaidized tests. These statistics mdieate a need 
foi some in-service work in school districts to assist their teacheis in 
more full> undcistanding and piopcrK using the test lesults uhieh 
appear to be leadily available. , 

Teacheis were next asked to check all of the tests which theii school 
systems administered to pupils in grades 7-12 in foui categories. In- 
telligence, Standardized Achicncment, Reading, and Standaidized Ap- 
titude Tests, rhe tests cited most frequently in each of the categories 
were these: 

//j/W//£,'67«6^'— Stanford-Hinet (1 16),aiKi the California fest of Men- 
tal Maturity (10(5): 

Standardized Achtevement—CoWcgi: Boaid Achie\ement Tests 
(232), loua Tests of Education De\elopnient (191^ ^NV^v Vork State 
Pupil Evaluation Piogiam— PEP (167), and the Stanford Achievement 
Tesi(l53); 

ReadingSRX Achievement Series. Reading (153), Mctiopolitaii 
, Achievement Tests. Reading (152), and Gates Mac Ginitle Reading 
Tests (1 10). (82 lespondents ^aid that other reading tests besides the six 
listed in the survey were administered in their school systems), 

Standardized Aptitude— Stholasik Aptitude Tests— SAT (318), 
Preliminaiy Scholastic Aptitude Tests— PSAT (309), Regents 
Scliolarship Qualifying Tests (290), and Differential Aptitude Tests— 
DAT (129). 

Scleral infciences can be made from the data above as well as from 
some of tlie other icsponses in these categories. For instance, other tluui 
tlie SAT and the PSAT, no test w.is cited by more than 50% of the 
teachers. This indicates the great multiplicity of testing programs 
tluoughout the staje and fuither points out the need for explanatory 
sessions particularly foi new leachcis— or fur cxpeiienced peisonnel 
wlien new testing programs are introduced. 

Tlie New Yoik Slate Pupil Evaluation Program (PEP; has been in 
existence for the past four years in all school systems in the State. Even 
though it is mandatoiy at the uii.Mh grade level, only IG7 tespotuients 
recognized it as being administered in their school systems in grades 7- 
12. While neuspapeis, pauicidarly in large cities, frequently cite the 
results of this test as an indicatoi of the succcs or failure of the schools, 
only one-third of the teachers listed this test on the survey. 
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In addition lu the above icsults, thcu' u cic niaii> tcarhcis in each 
calci^iju who iiulicalcd that lhc> did nut kiujw whether thcii sihuol 
s>sinn adininistiicd tests in grades 7-12. 76 did not know about in- 
lelhgenee testnig, 19 about achievement testing, 17 about tests in 
reading, .md 38 about tests of aptitude. Some kind of infoiniation 
progiain about sehool testing piogiams issuiely indicated. 

. Ihiee Items un the sui\c> pertained to helping pupils prepare for 
suih staiidaidi/ed tests as the ,SA I i)i the PEP. 89 respondents stated 
that dun SI huol sv stuns lecjuiied English teachers to spend class time in 
special preparation fo; sui h tests. In a later item, 183 teaehers agreed that 
It IS a legitrrnati u^t of irrstr uctiurral time iri English elass to help pupils 
prepare for these tests, while 220 teachers disagreed w itir that practice. 
I low ever, there were 281 who indicated that the> felt coaching pupils 
could signrficarrtl> raise the pupils' scores on the SAT. Onl> 82 dis- 
agn id w rth thrsrteru w Irile 127 were uruiecided,e\cn though test makers 
.uul ctluc.rtrorral resc.uchers and writers note th«rt, u\er.rll, coaching w ill 
not alter puprls' seures \er> much except to make them more "test-w ise," 
i.e. ready for the mechanics of the particular test. 

I he practue of tracking or grouping pupils irr English on some 
pn -deter mmed hasrs was snrveved. The question was, **How rnan> 
Hacks an tlrerern>our sehoors Enghsh program?" Ehree tracks was the 
Kspunse of 171 people, four tracks had 96 responses, two tracks were in- 
dicated l)> 92 tiaclurs, fi\e or rru)re tracks were listeil b> 11 responderits, 
om .rack was cUed b> 8 people. "Phere were 75 teacliers who stated that 
tlie>r schoiiPs Enghsh program had no separate tracking system. 

A ttnal of 38b teachers irulrcated that pupils weregroupedor tracked 
on thi basrs of both starrdardr/ed tests and other factors sue h as grades or 
Haclur reoMrrrnmdatroirs. 12 others stated that pupils were grouped 
soU l> ontlie basrs ofstand.udi/.ed tests of IQand or reading. Once again 
the pudrferatron of practices shows a real need to study the situation to 
In ,suie that whatever is being done in tlie school system has a purpose, 
arid that tlu purpose fur grouping pupils is rational and educationally 
sound, and rs done w itiienrt prejudice te)ward any groupor individual. 

I hcie were se\eral rterns pertaining to the New Vork State Regents 
Comprcherrsrve English Examirratron. Nearly 60% of the respondents 
(29<)) indieatcd that then school system lias a separate cmiiculum or 
Iraek for those puprls preparing to take the Regents, hi addition, 95 
le.rclurs crte d the existence of .i separate elective course which pupils 
lake toprejjare them for the Regents. When asked about the propor tiori 
lif puprls in tlu ir stiiool system who lake the Regents e'xarn, 95 teachers 
sail! that less than 50% of the pu|)ils take the exam, while 281 teachers 
said that nuiie than li.df the pupils ilo take the exam at some point in 
llien high school yeai.s. i hcie were 153 teaelieis who did not know the 
piopoitioii of pupils taking the exam in their school system. 

hi lespunse toai* attitude que stion about the Regents examination, 
257 teae lieis (53%; meheate'd that diey felt that the Regents exam has a 
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rcsiriciive iiiflucntc on llic ciiriiculum fur llic siudcnis who will cvcii- 
lually uke the exam. Only 1 75 (35%) did not feci this rcsirictiv c influence 
wliile 53 (11%) were undecided. In the continuing coiuro\ers> o\ei the 
value of administeiing the Regents e\ani5 in New York State, these 
figures seem to show that English teachers would lathei not have the ex- 
ams since they tend to restrict the school's cuiriculuin. Moie is wiitten 
about die Regents and the curriculum later in this ai tick and elsewhere 
in ill is issue. 

Regents examination scores arc used in a variety of ways m the 
various school systems. 286 teachers mention that Regents scores are in- 
cluded in the pupil's end-of-the-year final average in English. Another 
131 teachers iiidic»Ue that Regents scores are used solely for the pui pose 
of the pupil's obtaining a Regents diploma and aic;_not counted tuwaid 
any average or end of coui^c evaluation. The Bureau of English Educa- 
tion of the New York State Education Department indicates that the 
choice of how to make use of the scores is left to the school system, 
although any pupil may attempt the examination even though not 
. specially prepared or grouped in a Regents tiack. 

The most common examination practice m English classrooms m 
New York is the practice of the classroom teaclier(s) of that couise or 
grade level preparing the exam for the pupils in the school. There were 
. 299 teachers (61%) who indicated this on the survey. Other responses on 
eiid-of cour.se exams included 72 which were prepaied by a school cf^in- 
miiice, 8 by depaitment chairmen, 15 by a district committee, aiid j by 
the central office staff. There were 83 teachers wliofelt that tliequestion 
was not applicable to their school systems, probably because they 
prcpaicd tlieii owncxamsoi becauseiio final exams vveregiveii. L.iter in 
the survey, teachers expressed an overwhelming preference for iwo 
types of end of couise exams— self^jrepared (57%>or cooperatively coii- 
siiucied within one school (27%). Only 35 teaclieis (7%) indicated a 
preference for the Regents or some other state-wide exam. _ . 

When asked about the quality of end of course exams not solely 
prepared by the teacher of the couise, 80 teachers indicated satisfaction, 
133 cited the need for improvement, and 51 indicated that tlieciuality 
was unsatisfactory. This item was followed by one which asked if 
teachers felt that the content of their English course was lestricted by ex- 
ternally prepared exams like the Regents oi a district-wide exam. The 
teachers were nearly evenly split on this item, 215 saying yes they fell 
resiricted in content, with 239 saying they did not feel restiicted. The 
split was a lit tic different when the teachers were asked if diey felt that ex- 
ternally prepared exams restrict the way they conduct iiistiuctioii in 
English class— 206 said thai they felt a lestrictioii in methodology while 
/ 270 said that they felt no such restriction. 

To find out what teachers might add to tlieii English courses if they 
felt no lestiictions because of standardized tests oi exteiiially prepared 
exams, two cjuestions were included in the survey. One dealt vvitli the 
content of the courses,vvith 161 leaclierscitiiigvalue{>claiificalioiias the 
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luiilciU wuukl »uld. I his ftjlluwal clusiiy b> inodciii fiction 
{ 1 j8). film MikK «iiul rtadiiig mstiiictiiJii ( 152j. Feminist litci.uuic 

01 } fuiiiuil i^i.iiiiiiuii iiistiiiLtiuii [11) were the cuiitciit .idditioiis 
k.isi f.i\uial. 1 lieu weu' 1 11 teaeheis who would make iiu changes in 
the content of their coiiise^j. 

I Ik seu/nd question dtalt with iht at tivities which teacheis would 
eiiiplt«isi/L moie stiongl> in tlieii English courses if there were no nun 
dated te^ts. C.ieati\e peisun.d wiiting was ihn actnit> cited by the most 
ti.icheis (222). Othci ai ti\ ities w hicli iccen.cd emphasis were iiuli\ idual 
student projects (201). diainatic activities (182), and small giuup dis- 
cussions ( 181 J. Iheiewcie 131 teacheis w ho said thc> would not change 
the emphasis of the activities in their English courses. 

riuujuestion of te.Khei .iccountability for pupil learning is one 
which has been i.iised in lecent \L.ns. rheie has been much writing both 
loi and .ig.mist tlit .iccount.ibilit> nun enieiit in education, some saying 
tli.it acctnmtabilil\ will pioduce nothing but test taking pupil-iobots, 
whik ijthcisaigut that .ictount.ibilit> is \ ital if public education w.ints 
to lonunue to leieni t;i to inciease its share of the public tax dollars, 

I he suivey asked tin question, "Foi which of the follow ing should 
tc.K-heis be held accountable?" (clieik all >ou feel applicable). The 197 
lespondees answeied as follows: 

•1()7^ their subject matter knowledge (94%) 
126 knowledge of the factois diat influence learning (86%) 
398 till use of piofessionall> sound instiuctional procedures (80%) 
79 measuiable giowth in pupil learning based on standardized 
test scores (16%) 

280 measui.ible giowtli in pupil learning based on accomplish 

ment of the teacher's instructional objectives (56%) 
300 spccifRation of dcsiied instiuctional objectives for their classes 



129 satislactoi> demonstrati(Jii of classroom teaching skill (86%). 

It might be s.iid on the basis of die abo\e figuies that New York 
St.ile's hnglish ti.ichcis aie w illiiig to be held accountable for those fac 
tots ovei w Inch tlie> li.ivi some cuiitiol— know ing their subject m.ittei, 
deiiioiistiatiiig their tuicliiiig skill, specifying objecti\es foi their 
classes. I lie> .iie .ilsu w illiiig to be accountable for using sound iiistruc 
tioiial pi i>cedoi t s .ind know iiig (and apply ing) the factors that influence 
learning iii their ckissioonis. On the other hand, teacheis i eject being 
held aicount.ibli foi pupil le.iiiiiiig b.ised on st.indardi/.ed test scores, 
piobably bec.iuse they know oi iiiuiiti\ely feel thai these test scores are 
based on int;ie factois than just the teachers own classroom abilities oi 
e\en un tin pupils' know leilge of fat ts presented in Knglislu lassrooms. 

I lull isstJiiii uiiciit.imty shown in the lesponses to the item asking 
whetliei till tiaclicis would be .ucountable for growth in pupils based 
on the teachers iiistiui tioiial objectives. Later in the survey the teachers 
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\\cie asked if ihc> ftli it was possible to spt if> iusiriiciioucil objectives 
in riicasurable terms for all <iie<is of Enghs.h instruction. Only 102 
teachers (21%) agreed that it uas possible, \vhile 336 teachers (68%) dis- 
agreed \N ith tlu possibility It appears that the\* illingness to writeobjec- 
li\ es is soineu hat tempered by the belief that sonieof English classroom 
instruction cannot be stated in objective, measurable lei ins. This is a 
dilemma which merits moie investigation and discussion as the 
accounlabiliiy objectives questions beiome issues in more and more 
school systems. 

Several more items on the survey dealt w ith teacher attitudes toward 
accountability in theprofession.There were 331 teachers (67%) who felt 
that they could suppoit an accountability program if its goal was toim- 
^ piove instruction in English. They also felt (398—80%) that .success in 
school achievement should be measured by results achieved in theactual 
situation of the particubr school and the particular set of pupils rather 
than by a standardized lest. 

52% of the teachers (261) stated that they would continue in the 
scliool system if their local teacher association agreeci to an accountabili- 
ty program, even if the teacher himself did notjikelhe program. 
Significantly, (here weie 169 respondees (31%) who were undecided 
about this item. When asked if they would attempt to find a posuion in 
another school system if their system imposed an accountability 
progiain on its teachers, only 51 (12%)said that they would. 227 teachers 
(16%) said they uoulJ not try to find another position, while 191 (39%) 
were undecided. The small number who said that they would try to move 
should encourage school systems on the issue of accountability, par- 
ticularly in V ieu of the shortagejof teaching positions in English. There 
would undoubtedly be many other factors and pressures brought to bear 
on a system whi^h imposed an aiccountabihty program on its staff. Yet if 
these figur.es reflect the feelings of a broader range of teachers, who 
knows wh'M is possible? | 

U'hose who responded to tile survey wereconsistentin their feelings 
against using standardised instruments to measure pupil achievement 
in English. A total of 399 teachers (80%) stated that they felt standardized 
achievement tests are not adequate measures of pupil growth in an ac- 
countability program. Another 288 (57%) disagreed with the statemjcnt 
that gain in pupil achie\ement based on a pre test,, instruction, artel a 
post-test is a satisfactory method of evaluating a teacher in an 
accountability piogram. In fact, 210 teachers ( 18%)" felt that there is no 
satisfactoiy method for evaluating a teacher on the basis of how well or 
poorly his pupils perfoim. Only 139 (28%) felt there was a way of ac- 
complishing this evaluation, and 109 (22%) were uncertain. 

There were a few other issues and attitudes covered in the survey, 
but those leportcd heie seemed to be central to the interests of the profes- 
sion. Standaidized testing has grown into a multi-million dollar 
business in this country English teachers and all other educators, school 
board raembers, and parents need to pay close attention to the uses of 
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tests in ilicii scliouls. Tciicluis need to be belter informed about the 
testing progiams then* paiticuUir system administers, and tliey need to 
speak out when they feel that the pupils or die teachers are being 
somehow abused by diegiversor interpreters of any test or series of tests. 

Tins sur\ey reflects somestiong, negative attitudes in the English 
teacliers of New York State, particularly toward the Regents Com- 
preliensive Englisii Lx»jmination and toward the use of standardized 
testnig to ineasine,teachei effectiveness with pupils. It reflects a greal 
lack of mformation,on the uses of tests in many school systems. There is 
al^su. an incffcation ol the great variety of testing programs and 
organizational patterns in English classes as a result of the testing 
programs. 

In spite of all of tiie confusion and misapprehension, however, 401 
uf tlie respondents, a huge 80%, agreed with the statement, 'Teaching 
English in pui)lic schools is a good career choice for me." Only 18 (4%) 
said that it was not, w hi Je 66 ( 13%) remained undecided. This speaks very 
Inglily of the state of the secondary school English teachers of New York 
ulu) app.iiently enjoy theii teaching careers even while wrestling with 
all of tlie coniplex problems and issues discussed in this survey. 
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Evaluating and Liberating 
Teaching and Teachers 

by Morris/ Finder 

This issue of The English Record is devoted to testing, which is an 
aspect of evahiation. An understanding of evaluation is therefore 
prerequisite to an understanding of testing. Budijesimg and evaluation 
are means to the improvement of teaching and to the mtellectual and 
personal freedom of teachers. To justify these assertions, this article 
describes evaluation and its procedures and uses, it explains also wh> 
and how it offers teachers increased freedom. 

Evaluation of teaching or of anythmg else is a process of deter- 
mining the extent to which the purpose has been or is bemg achieved. If, 
for example, the purpose of a hardware stoi^ is profit, then we evaluate 
by assessing its profit oi loss. Similarly .* the purpose of teaching is the 
learning of students, we evaluate by finding out the extent lowhu.h the 
lead ling has achieved the desired learning. From this purpos_c, the 
'procedures of evaluation may be inferred. The following list, then, 
specifies the procedures. 

1. Obtain a statement of the program's instructional objectives. If 
^ one is not available, formulate it. 

2. Select or devise exercises, problems, or other tasks that give the 
student the opportunity to exhibit the achievements specified by 

^ the objective's. 

3. Administer the set ofxvaluativc tasks. / 

4. Obtain a record of the student's performance, 

3. Determine from the record the extent to which the performance 
exhibited conforms to the performance desired. 

To illustrate the uses of tlirse pnxedures, v\e take as an exaniple the 
objective, "Identify devices of persiaasion in advertisements." With the 
objective stated, vvc then go uu to select situations or problems that give 
the stmlcnt the opportunity to exhibit the extent to which he has ac- 
quired that achievement. It is easy to infer thattheevaluativeproblems 
would be a setof .idver tisements with some such instruction as this. "For 
each of these ads, identify the devices of persuasion incorporated into it/' 
\Vc next administer this set of problems. The students record their own 
performances .is a consequence of taking the wiitten test implied. The 
teacher analyzes the results to determine strengths and weaknessesof the 
performances .intl, (hereby , ol the teaching. For example, the results may 
shovv vveaknesses in ability to perceive this or that device of persuasion or 
v\eaknesses in these related skills, and so on. From such mformation,4he 
teacher makes changes in the program, te.iches it again, evaluate^, 
revises, and so on without end. Planning and teaching, then, is a con- 
tinuous, cyclical process. 
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Mastery Icaiiuiig tMinplifu's cvaluatiuii used to impiovc iustrm 
tioii. Tests that aie wiittcu fium cxi^licit mstniLtional objetthcs arc 
souictiincs called inasttiy tests and souictiiiicscii tenon tests. Another ai 
tick in tliis issue desciihes cMtciion tests and compares them with tesis 
called standardized or norm-related. 

Benjamin S. Bloom and his associates at the University of Chicago 
have been investigatmi^ the possibihtics and pioblcinsof mastery leain 
ing. The assumption behind it is that some 90% of students can learn 
what is taught provided the teacher identifies explicit instr^K aonal ob- 
jectives, uses appropriate means to obtain the learr/' * objec- 
tives specify, evaluates often, and adjusts the instru< » . tu ^ infor- 
mation yieJded by the procedures of evaluation. 

Bloom gives good reasons for rejecting the frtniiliar practice of 
grading on a curve. The bell-shaped curve, he reminds us, is the model 
for random activity aiid chance. Because teaching is a purposeful activi- 
ty, there is reason to suppose that teaching is unsuccessful if achieve- 
ment corresponds to the model of random activity.^ 

There can be no more impoitant use of evaluation than the im- 
provement of instruction. A unitof instruction is likely tobeunproved if 
evaluation occuis at least three times, at the beginning to assess the 
leariiers' strengths and weaknesses, toward the middle to measure 
progress, and at the end to determine the sueeessof theentire program. 

Although we have used a papt. and pencil test to exemplify an 
evaluative instrument, evaluation cannot be limited to such means. If, 
for example, an objective concerns public address, then a vatid evalua- 
tion must put the student tov^ork addressing an audience. The record of 
evaluation, then, would be provided by those evaluating, probably 
assisted by criteria that define satisfactory performance. 

P'or another example, if the objective concerns effective group dis- 
cussion, tl.e corresponding evaluation implies a group situation with a 
record to be made by those observing the situation. Only in paper and 
pencil tests do students record their own performances. 

Nqt only is evaluation grounds for improved teaching, but its 
results are informative to the administration, the community, and, 
sometimes, to the profession. 



sueeessof a program, it follows that th^ success is in principle* indepen- 
dent of opinions about it. If, then, a te^icher has fjlanned and executed a 
program that sound evaluation shows to be successful, that teacher is 
thereby successful, regardless of positive or negative opinion. From diis 
we infer the ultimate principle by which to establish both the freedom 
and responsibility of the teacher. He is successful to the extent that he 
achieves the ends to which his teaching is a means. 

This article, then, has explained the ev.jluation of teaching and has 
suggested its uses in improving instruction, in informing the ad- 
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ministiatiui), tlu iuiiiiiiuiiit>, the piukssiuii, atid iit [jtoiiiutiiig tlu' 
Jreedoin of ilie teacher. 
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Criterion Tests and 



Standardized Tests 




1. what normed or standardized tests are, 

2. what criterion tests are, ancj 

3. what the differences betweeh these are. 

Oik's know ledge (.)f these distiiictiuns is prciciiuisite tu the uueihgeiu 
conduct and judgment of schools and teaching. 

Let us consider fiist the nornied or standardi/.ed test. A brief 
historical note ean help. In 191 1 there weie about 139,000 soldieis in the 
United States Arm v. With the onsut of World Wai I, die aimy grew 
rapidi) to about t\v o million. Therefore thearm> \\ as faced with an im- 
mense .task of soitmg. Who should go to officei candidate school? Who 
sliouki go to tooks* and bakers' school? Who should be selected foi this 
knul of job? And who foi that? fhese decisions had to be made promptly 
and so p>schologists \\eie put to woik on the pioblem. One result was 
ilie Army Alpha TesL When this test was administcied to an unselected 
gioup, theaimy was told who was high, middling, .nid low on thispai 
liculai instrument that me.isuies some notion of mental aleitness. 

When the wai had ended, some of the psychologists who developed 
these tests took jobs in colleges and universities. They taught the tech- 
niques jf test construction they had developed in the army and adapted 
these to civilian educational uses. A result is that today such normed or 
standardized tests are widely believed to define educational testing and 
are often called, and believed to be, achievement tests. The following dis- 
cussion shows, however, that both of diese popular notions are dubious 
and a cause of some serious rnisunderstandirigs. 

Wt begm by explainmg why standaidized testing cannot be equated 
with educational testing geiiei.illy. If you had to write a standardized 
lest. you*d have to devise items that half the typical takers of the test 
toukl not do. If the typiuil student doesirt fail half the items, then the 
te.st isn't functioning as a standardized test must. 

It IS easy to see, then, that the basis for w ritiiig a standardized test is 
not what .students know oi can do. Rather the purpose is to determine 
how ont student conip.ires with aiiotliei on a scale from high to low. 

But schools and tuicliiiigare intended to lia\e students know things 
and be able to do tlinigs. It would follow that foi piactical teaching, the 
nglu kind of test is out that gius the student the opportunity to display 
llie extent to wluch he can do the things hi has been taught todo, undei- 
sland, appreciate, and so on. Such instiuinents of#»valuatioii get at 
dcsued aeliicvi incut. I)t spite this, we find that school systems typically 
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uiiasiiu and upoit ciLu.UioiMl gum tli n^t uith tests dchigucd tuicrkcl , 
spiiiricalK u h.tt stt^uktits luvc been taught Init \M\\t\ with tests intend 
cd to disciiunnatr among stndents. 

Wi iiM- the tinn uitcMon tiht'iii "ciitciiun-iclatar'oi "ciitcrion- 
uUunutr' to name tcst.s that mcasinc diicctl> and spttifuall> the lu- 
nntions of tuuhmg. hi snch tests, noiming oi standaidi/.ing is not in- 
\iihed. And the test disei iminates onl) on siieh matteisas uhethei llie 
stiulein possesses tht aehievements desiied, I o wiite the test i.s to eheH 
tlie skills taught, l oi a uiteiion test, sneh skills and othei behaviois aie 
llu niteiia of test eonstuietiojj. That explains sneh teims as "ciiteiion- 
uiaied" and "eiitei ion icfeieneed," aiid w In it is reasonable to eal I sneh 
instruments achievement tests. 

It iseas> tosa» then, tlu did)iet> of t>pieal repoi ts of school systenis. 
A school s>stem ma> iepou, foi example, that the aehievement in 
leading of its stndents is good, bad, oi indiffeient. l ypieall} the data arc 
based on jesnlts of this u\ that standardized test. Toi reasons given, the 
^alidit> i>f these lepuits, including lefeienees tograde level equivalents, 
au dubious and misieauing, n is fail toeoiielude that sneh misleading 
1 ('ports exemplify a misuse of staiidai*di/.cd tests. 

J lie "Coleman lepoit. ' and the "J eiicks rcp^Ml" exempli f> a second 
and iclated misuse. In the wiiitei, 1971 issue of The Public Interest, 
Ralpli \V. fvler notes th.n the Coleman lepoit on Equality of 
Educational Opportunity and Clnistophei Jencks' book, Inequality, 
elaiiii thai schools arc relativel> ineffective in teaeliiiig the dis*idv*in- 
laged. Tyler points out, however, that 

Kiith (Ik CaAk nun «iiui itu Jiiu k^^Ui(lKM.\.iiiiiiUil (liffitiiui^ in mukn <m sUiUihiid 
iisis .uiioiig (lifkit lit i^ioiipN ui cittidiciL 1 lit) diJ nut usk uh.il diffucnt .^luups ul 
< liiidun ^i.ul lt«tiiutl liiit kmIki uh.it nicaMiriil v.iri.ibkso-eMKiuKunoinu statu.s/ 
uiii iil.ueil l(f (hillKUu.N 111 .^(Uii.N. 1 lit staud.ud tc.^t^ usK'il uui nurui-Kf<.K'iRal 
iists. In ijuiKluii; tiKH K.Nts. i|(4(.NtioiLs tluit inosi i^lnldii inoukl.inswi-i cuuictly ucu 
clnnnuittil, Ijut (|U(.^(ionN ulnt^li unU .iljuut lialf tlit ( InUiun loulil .tnsuci cuiictll) 
uctc u (.iuiiil. 1 Uis UtiNiluiK' nt oiiki to spK.ul (Ik MuR*>di» u tikly a*> possible tli<u 
tfnMrcn unilil U air.iii^cd uii .i MaU lioin lui^lKst tu lowest. 1 litpuipustof ikjiih 
iifiiinuil lists iMu MUt Miul( tits, not toasM.NN what thc> luui liainiil. It happens that 
uiaii> of till mills tli.it ail cfU'itiu m.^harpl) .sortini; stoiliiit.s aii ihou that arc lujt 
. c'lnphusiA'd ill a majority of mIiooN.-^ 

Tylei goes on lo note that b> age 13, 80 pei cent of American 
'(^Inldren can reai* and compieheiid a t>pieal iieuspaper paiagiapli. An 
exeicise such *is this is included in the National Assessment of 
Kdueation<il Piogiess. The pmpose of this Nalioiuil Assessmeiil is to 
lepoit what piopoition (if eliildieii luts «tequiied this and otiiei useful 
skills that schools do teach. Such an exercise is not included in standard- 
ized tests for 13-yeai old children "because it does not sharply separate 
the vei> skillful leadei f.Uiin otlieis."^ Coleman and Jeneks ueie using 
tliese standardi/eil ti^ls bee*iuse the> show the Kugest diffeieiiees*iiiioiig 
groups. riie> fiHUul that faiiiil> baekgiound was nioie lelatetl to these, 
differences than the i ffeUs fif the school vveie. But neithei the test data 
iior the method of *inal>\sis of vaii*inee tluit tlie> used tonld *iiisvvei the 
(juestion of what most cjiildien had learned in school. 
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It fullo\\> thai if \\i want lu know huw good sdiouLs ami teaching 
au \\c uuibt'ust tests that incasuic what schools aiul tcachcis teach, I'hc 
tests nnist he so uiittcn that if the stiultiit has Icatncd, the test w ill show 
it. I railuisian wiitc siu h tests ami put tlu m to iuiistuieti\e uses, riu* 
ptiiuipU foi wilting the test is simple ami ob\ ious. Begin with 
vStateinents of what tlu stiuknt is cxpceted to know oi do. Fhen wiitt* 
items that gi\e liiin the oppoitumt> to exhibit these desiied 
aeliie\ eiuejits. If, foi example he is to be able to state the liteial sense of 
what is going on in a hiii poem, then piesent him w ith a l> ml poem that 
piesULi.ibl) he hasn't seen bef(;re but is within the lange of his ex- 
peiieiice .uid .isk him to expl.iin what, litcrallv. is going on in it. 

Stand.iidiml tests, howevu, do ha\e then uses, if theie is a nee'd foi 
si;i ting students on .uangi hoin low to high, then a soi ting kind of test 
is a|;p!opriati. College adinissu>ns tests exemplify one of these usesanei 
the (Jiaduate Retoids Examination exemplifies anothei, 

riu puiposi of tuiehing, however, is not to sort students but lathei 
to lulp tlum ticlmve. Bee.iuse desiied aihie\ements ate the eiiteiia foi 
wiiung ciiteiion tests, these are propei foi ixpical classroom uses. 

fo suinmaiuu Standauiimi tests are inteiuied to soit people out, 
not to I hyStTcarniTig^J^nighl b> particular teacheisandschools. It is mis- 
kailmg^^m^fuu, to\usi the lesults of standaidized testing alone to 
lepKsent tin aetHt*^nents of educ.itional progi.uns. It is also mis- 
leading to usi st.mdaidtzed tests toeonipaie one school or school system 
w itit anotht I. such compausons.ue itot net essarily b.isedijn.the skills oi 
olliei kinds of beha\ior thai an> or all of the schools imolved June 
tauglit. A piogiam of instiuclion is piopeilj assessed b> ci iter ion tests 
because tluse are based on the skills taught .md so written that ilie 
stueleiits to be te steel ale gncii an oppoitunit\ to demonsli.ite the extent 
to wliich tlie> ha\e aiejuiied the eicsired learning. The results of such 
tests preside the piiin.ii> aiieptabic b.isesfor inipro\ ingoui sehoolsaiui 
our teaching. - 
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Limitations of Standardized 
Tests As They Apply to 



Prior to ESEA funding in the|latc fifties and early sixties, standard- 
ized testing had basicaii) served the interest of the practitioners in tlie 
M hool sc ttiiii;— tiaclui.N, adnnnisuaUjis, lolk.m aihnissiuns offitus, 
and ii'seaich aiic! (k'vclopiiieiu suiff. 

I lu late fif(it«>andcail\ sixncs biotight todu atuntiou ofnaiiuiiai 
liailcis dining (A;ngi( ssionai debate on sever.il massive .lid-to- 
(.iiiiLaliiJii bills, the iiud foi dcpend.ibk inforiuadun in cvalihituig cost 
Ixiiifits of tognitivt giouij) .iiui i>thei niated fatlois. pie loiite tlhit 
iiUiSt uscaich .hkI due lopniciit oig.nii/.itions, lured bs piogKinis for 
cvalthuiiju. tiM)k uas moniioiiug diroiigh and post-st<nid<ndi/td 
achievemcni tests. 

Once legislative di bates in <>tatc and uatiiiiiahapitois began, pid)lR 
attention, laigi Iv tinougli the inteicsi of the media, began to focus on 
"those tests/' 

** riiose tests," <>tauei.ueli/ed tesl.s, .ne tests cijuip . seel of empiric.dly 
selected materials. Thcv liavt dcfiuitt directions fejr use, .idee|uately 
determined norms, arrd data on reliability and validity.* 

I lu norinrng of all stanelardi/ed tests (achievcirrcru anel aptittiele; 
yttlds the tiveragc pe r forrnarrec rrr .i u stejf iJulelien of .1 ecr t.uil <ige ijr rn<i 
(crtain graele. Norrrr referenced tests .ne tonstrmted specifically to 
facilitate rrraking cornpar isorrs among students. 



As Lecjiia ry U i points out, in 1970 pid)li( attituele li.id sUoiigly 
developid with elotibts about the soeial utility of the whole testing 
enterprise." I'he te:sting irrdtistry has been subjected leceiitly to a 
national w.ne of dise iichantiiuiit, skepticism, <ind hostility a.se vielcnccil 
in iiunuioiis law stilts, eouit lulings, .md in the pejsition taken by tlie 
Assoiiation of Bl.iek Psyi hol(;gists anel the AiiicriL<in Pcisonnel .ilul 
Guidarue Association. 

The fuior stems basically from two major iiritarits. I he fiist, Stan- 
daidi/ed testing has been utilimi piuiiaiily by our mstitiitions to 'wall" 
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sukIcius 111 ami lu wall" some out, to pruv idc schooling oiil> for 
SOUR childRii and cducaliuij foi olhcis, to picdtlcrininc life styles and 
careers foi select gioups of the population, to wrongfully classify and 
label segments of oui school populations, and finally to picscnt 
aiguiiicnts (at highly placed souiecs) foi heredity and genetic endow- 
ment as the predominant determinant in explaining the consistent 
diffeiences in obtained means between test lesults of majority and 
minority populations. 

Evidenceoffciedby Bloom etaL( 1971), Goldberg, Passow andjusi- 
man tl%6), Gt>odlad, (1966), Eash, 1961, Borg, 1964, Schwebel, 1968 
negates the u.se of .si»indardi/ed tests to predict »ind select uilent. 

I he second irritant is inheieni in the design of standardized tests. 
Obviously,, the scoies do not teptesent whai a student has learned but 
wheie he elands in lelaiioii to other students. Traditionally among test 
makers, tlie litems selected aie those found in the tryouts to differentiate 
most sliaiply among students, items that approximately half the 
students answer correctly. 

In the laiiguage of leporting, grade ecjuivalent misinterpretations , 
aic piobleiiiaiie and misused. Grade equivalent means that on the 
specific test tlu iiuiiil>ci of iieinsjhat the student answered correctly is 
equal to the tntduvi of the number of items answered correctly by all 
students in the noi inmg gi oup. E.g. 1 1 is possible for a student in the 8di 
giade to gam 8.3 in njinprehensioii on the low »i Tcst of Basic Skills and 
not liave masteied the iiifejcntial skills. Depending on the spread in raw 
scoie points, langcs can amount to three months growth on one part of 
ilie scale and tlnci years on another part. Units arc not equal throughout 
ilie scale. 

1 lu design of staiidardued tests by their very nature must penalize 
it> some extent linguistic, experiential and cultural differences. The 
evidence Ks^tiunglhatall tests, published and unpublished, are biased to 
some degiee. 

. l attois. Cut\^iuenu--T\\i: response must match the preconcep- 
tions of the lest inakei. There is no allowance for divergent thinking. 
PTOicduics u^ed in item tyiouU — These procedures create further 
problems, ns explained by Green (1971): 

1 liiii IN. I hi.t>til i iiii I ^%tKii il.u.i ftoiii tlu jHjpuLiuon, oi a«».iinpk of i(, .irc uscii 
(ti (hi iiliiliviiUNxif i!u U^t b> uici llllg, t( attailglllg, diul tcw t tlillg tlCIUS. 

I hi> }il<Kiiiiir( In (NMtilhtl U) piiMlutihg all ({r('Ul\c actlic\ CliU Ml lC5l, but itlC llll- 
pitiviiiunt iliitviil liuiit i( \s tiiufi)iinl\ iKtufuiai lu ail gioiips. Hetausc ihe 
i liaiat u iiNiiiN dI liu }riiil4)iiuii.iiit >;iwu|> in ilu <>ainplc (ieiCMtiiiic ilit t epulis of ilit^ 
Mcp liiiiitiiaiily i.iliiit oh lUiii u>iiuO, ilic ic^i is UMiali> .shatpiy titiprovcd for ihai 
^i^ioiip iiliiN \s .1 ili Miabli a Mtio hui u laiivi l> ie^:^ niipiovtil fi)r nnnoniy groups. Hic 
iiiiiKri i(> cli iiii uis iu ilii ^.iiiipk K^^'^M^ ^1^' ^ tu^isc in (lie (laia if ihcy react to tlie 
iiiaiii taK ID .tiiv i\.iv iiithki ila iii.tjont) bta ilnsiKKsniiUnbsianiialiy affect tlic out 
tonit. ria c!iaiaticiij»iu^of the inajonty group remain tlic determining factor in the 
puKov I he liMih f><i Initii u^i fiir itMuy chiUliti^i but a relatively more biased tCM foi 
(tiOH iiiiihiiuii> uh(»sc >(ylo (hvcrgt from the majority of the ityom group. H the 
(lyifiit gioup i\Ui piiiliFitim.iiitly blat k« bKu k>u(^ul(l be the majority gioii|7.liul tiu 
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would ini[)rove lUv icsis tuoit Un ilian thanuiheri.a.r. 11 uuiiliiitnd to make ihetest 
biased against wJuics ami oihor tion black groups. 



WHAT TO IX) ABOUT IT 

A mciiibei of the lesiiiig iiulusii^, Givvu, 0,R. { 1972) Miggcstb thai 
lacial. cultural, and ethnic bias in tests tan be alkMatcd ui tests b> ad- 
ding steps to the constiuttion piuceduics used in buildnig die nuini- 
achievement tests and b\ using ciiteiioU'rcferrcd adiie\ement tests foi 
certain purposes. 

Specifically, Green purports that*'deterniinatiunufbiasinustbean 
empirical pioccdure that includes diitct examination of situation and 
data after materials have been prepared. The most proinismgi,olution to 
these dijemmas is to use item \\ riici^ and editors that represent all major 
ethnic and cultuial groups in the population, with each gioup produc- 
ing a separate trial version of the test. The second step w oukl be to ti y out 
all the inatei ials on each swhi^i oupsef jarately. The thii d step would be to 
select items fiom all versions .uul edit them to best sei ve the inteiests of 
all groups. 

Curieniachievcinent tests arc focused on average perfoi riiance, and 
their exeicises aie concentrated in a middle band ol diffKult>.Accoiding 
to Ralph W. Tvler (1970), "only about 3 perccniof the exercise in coiii- 
uionly used tests are relevant to what is learned by students who are in 
the lowest third of their group. As a result we have not had means of 
evaluating the progress being made by the lowest third." 

Tyler, as does Green, indicates that it is not impossible to construct 
valid exeicises from, both tails of the distiibution, by obtaining the 
assistance of teachers and supei vision and by careful revision in the light 
of tiyoul results. 



A LOOK AT THREE SPECIFIC TESTS 

As the raging debate continues over the "use" "abuse" "misuse" 
and "nonuse" of standaIdi^ed tests it becomes incieasiiigly necessaiy for 
secondary school English staff mcmbeis tuexainineas carefully aspossi- 
ble the limitation of any staiuiardi/ed test that a^distiict has chosen.-^ 

A close look at the Icjwa Tests of Basic Skills (Houghton Mifflm;, 
Metropolitan Achic\enient Tests (Haicourt Brace Jovanovich) and the 
Mew York State Test in Reading-Beginning Giade 9 (New Voik State 
Kducaiion Depaitmcnt) indicates that the principal uses of these 
achieveitient tests are to ( I) evaluate the status of a set cjf students in a 
class, in a school, or in a school system, (2) evaluate progiains 01 pro- 
jects, curricula, and instiuctional mate 1 ials, i3) diagncjse pupil, class, 
programs, or system piobleins, and ( !) pio\ idc a basis foi planning in- 
dividual, class, or system programs. 
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Iowa Test of Basic Skills (ITBS)— 
Level 12. 13. M, Secondary (1972 Edition) 

, Ihisi(sl isd( si^ncdlo test a(hie\(nuni in llu Luii;iMi;( ailslusit 
skills aiuis \utal)ulai\. leading ujuipK Iuiisidii and llu lani;uai;( 
bkilLs (ii siK'Hing. (aiMiali/aiion. puiu luaiion. and nsa,m'. 

llu lUni spuad ni llu Kadnig i uinpK lu iisiun .sub-ust.s alUns Un 
molt idi4d)ilii\ uf stuns than llu t)ilui ,sul)-ii\si.s. In tach of the .sul)- 
skilLs usicd luuki Rti.i)ki,fuuni^ and L'tulcntamling hnjAied liu Lsatui 
Dvlaih, DisiD^'Oink!^ the l^urfjusc ul Maoi ideas of the Pa)a\^)aj)h o) 
Sehu'tion ihneaie U). 1'^. aiuL irnns lespeciivdy. 

I lu uii^ani/iitiun and i valuauon itini gi\c.s tlu usa kssitliabiliu. 
fot ilu-.sc au U)uf(\\. l lu nu>ic ' alike " tlu stoK Un the sid)gioup ni llu 
.spitifu sub test, tlu uu)n. tonsistentK di atunateK tlu test nUiisuies^..* 
tik inuie ULS( ^ du k au ni a subgiuiij^Df individuals \\ honiakediffuent 
su>ies. tlu num Mispeet we should be that theie aie 'chanee" faitoi.s. 
One \\a\ to .uoid "rhaiu.e" is to pi^^ide a large pool of items. 

llLspiuiMK foi thisieason diat the English Staff at Isa.u E. Young 
juiiun High Sihool base host n u) lUili/x . foi guuU diagnostic puipt)ses, 
onl\ tlu voiabulan.iompu hinsiun. andsp( llingsub-test.st)f the I'l BS. 

In tlu siib-U stsof ui|>itali/ation and piuu tuation all levels pio\ ide 
onlv oiu oi two ituius pei eath distieet skill. Oin staff feels tluit this 
siiiipK d(ns not yield uiough mfoiination and that the eluiiue kutoi is 
too high. 

Houghton Mifflin, publisher of the ITBS, states thai selections in 
the comprehension sub-test "were chosen in an aliempi to represent as 
toiiipleteb as pos^>ibk all types of teatbng mateiials encounteied bv 
pupiLs III tlu n ivtivday leading/' In level I 1 (gi ade 8 and 9) theieaie 10 
Items ba.sul on an nology passage. 10 items based on an animal eonsei- 
\atioii ptissagi, 8 iltiiis based on geogiapliy passage. 2 items based on a 
social sludus passage (tlu seleetioii deals with food piocess). 1 1 items 
bast d oiua biology passagi . 8 items based on a passage dealing w itb the 
evolinioii of the .ilphabei, and (> items based on onv poem, 

Siu li e\.nnmaiioii of p.Kssages used to "test" skills in reading toiii- 
pieliensuju eUai ly points up the nied to have school systems uiideistaiid 
that (oinpielien.sion is tlu j^ioviiue o{ all subject teadieis, fiut just 
English tcai lui.s. i\h)ffett ( \91i} pomts out tlia^ the skills "letalling." 
lelcitiiig implied and stated laets. " "making infeieiices," "diawing 
conclusions. ' nitcipic taig and piedictiiig outcomes." aieiiot \cibal or 
hnginstii skills but ilnnkini^ ofjcraiions. \U piopcjses fuilhei that 
' ie;iding conipielietision is meicdy coinpielieiisioii." 

Ronald Uai.ihaugh makes a similai point in his book. lieaduii^, A 
Lingtastit Perspective, . ."When a person reads he is processing infor- 
mation". ... It is the view of one of our reading specialists that visual, 
auditory, and linguistic fluency depend on the above skills. As the 
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"generaT' properties of tliiiiking are i>harpened, so is llie poieniial for a 
"good'* reader. 

Other subject .iica teaclicisat tlu sctoiulai> k'\cl should Ix gimkd 
to develop subject lelaled toiicepts ami skills simuhanu)usl>. Ileibeit 
llerber (1970) states, "Theie is a need foi whole new strategies in 
teaching leading tinough lontent aiea.s, a stiategv that uses what we 
know about the diiec t tcai hing of u.iding. but .idopts that know ledge to 
fit the structuie and lesponsibilities foi the tot.iU uirituluni ni each con- 
tent area." 

Our own item .nial>sis on the ITBS indicates that students acioss 
peuentiks did not do well on .dl questions th.il tailed fui a tomplcN set 
of skills in a given sub-test designed to test discreet skills. Kenneth Good- 
man (1973) calls this distoition of t.isk. [\vj following passage is an e\- 
ample froni the ITBS level 13, giade 7. I leie the student, in addition to 
pio\iding .mswLis foi skills in tin aiea of tonipiehension, must <ilso 
(t)iiipute. 

1 III hUn wluU . ih( Lnm^i Inini^ in.tiiun.a. may mxhi be ginu troui (hc^r.i, I he^r 

Oil aiul oth( i pKHliu u fii>in iUkm .iiKi iMiii i spti u s i>f u luiU ^ .in m in iinpuii.ini (o a 
nuinlni of luuiiUus. Sinn \\i)ililU.ii 11, tin. uLaluvJi.n^ Ik.».iiu sogiHKl.u Mkiiig.i 
Littli Ui.ii iliist n).i\ MH)n \n ii»; wli.ik s lt> i .ttth, lAfnUs s.t\ ai<tt tluir s\Uf 100.000 
hliu uh.iU'* in Auu .iiul Anuui in w.iit'ij. :U) .igi>, Ni>u ilus |ninlii iininbn aj 
alKitii io<m 

\n iHi^ain/.iiiun. ih( Inu ni.uioiial \\ haling C.« 'nntis^ion. is ti> in^; U) saNC the lilut- 
uhaU innn txtinutoii lis imnitxis. hoin fifuui nations, .ih ining lo gti ihcii 
naitous lu litiia ilu luitnlKi of whalisa \n haling (\i,ttliuon nia\ laiih ni .tiiN gucii 
\tai. i*am(nl.itl\ !»hu whaUs I hn\i'\ti. this is a \t>hiniat\ oigain/.iiion s\hith h.is 
no auau)rih ni^p( 1 1 itn i .luh of .i w haling ( N|Kaau>n. su tlt( .sJanghu i gt*cs oiu A 
woikabk law is iKttUa togi i ilu \\\u\U rsU; limit then iaktw\hinbtisi>f ihcoigain/a- 
tioiifiat th.iisiii hal.tss vmII iuiUi)in( in iinu and that tli( gu.iibUu \\hale isaooiiica. 

Question 1 10. What is told about the wh.deio since Woild Wai II? 

1) . "Fhey have become veiy efficient at catching wdiales. 

2) . riiey do not obey the law in (atching whales. 
.3). They do not catch any more blue whales. 

I), riu v have agieed to limit tlu numbei of blue w hales they xatt li. 
Measuies leiogiiitioii and Anidcist.inding of important facts .ind 
details.^ 

Queslioil ML A full giowii blue wliak would Ik most like which of 
these in length? 

1 ) . A fishing lod 

2) . A large house 

3) . A row boat 

'!). Thiee city blocks 

Measmes letogiiition and uiuk islanding of ini|;licd facts and 
lelationships. 

Questions 1 12. Wliiih of tlu si woids is diffeieiit in meaning fioin the 
woid extinction as used in the aiticle? 



PRING, 1975 



22 



21 



ERIC 

hriimiimrrriama 



1) , Kxiiiui 3). Kxisting 

2) . Desiruciion !). Kxtiiiguislu'cl 

Mi.isiius ikdmlioii of iiRaiiiiig uf uuik ui phiascs fioni coiiicxi. 

QiKsliDM IKl I Ik i.sHiiMU uf tin luiinbci uf blue \s li.ik'Miow alive is 
.iboui what pail of the luimln'r 30 ycais ago? 

1) . '2 3). 1 50 

2) . U -1). 1 100 
McaMiios rctogniiioii ami iiiulorsiaiidiiig. 

I Ik' 1972 almuii of I I BS .utcmpis to address itself to man> of the 
design crilitisins which were raised earlier in this ariiele. 

This eduu>ii does facilitate mdi\ idualiml testing if a distiiet wants 
to gk»in leitani km^ineteis ul iiifuiinatiun about a disuect population, 
u fatduatis uiduidu.d studiiit Ueni analysis, classroom item analysis, 
«ind building ittin .nudysis. Its noiming design seems to be slightly moit 
K{>usuitatt\i uf K il\ , luial, and subuiban populations than the eailiei 
editions. 

II()\Nt\ti. It IS m\ \KW thai distortion of tasks, woid isolation 
tesinig. ami iiitlnant selection of materials still exist in the test. 

Metropolitan Achievement TesC: Advanced 

riie Metiopolitan is designed to test word knowledge, le.iding, 
.spcllmg, study skills (Uicludes souice of information, dictionaiy, <ind 
libmiy skill tasks), parts of speech, and language (punctuation, 
capitnli/ntion, and usage). 

The sub- tests in reading are designed similarly to those of the ITBS 
Rcadmg Coinpu lu nsiun, the New Voik State Reading, and the Stan- 
told Achievement Paiagiaph Meaning "Ust (Ad\ancedj. Students read a 
paiagiaph. then answer questions about it. 

I hcK IS a w idci .spicadof items in eiu h sid)-teston the Metiopolitan 
(Advanced) than in each of the other 3 tests. 

I he same m)Uii t tif confusion in vocabulary ine.i'surement exists in 
tins list as in otluis, Woids aie piesented in isolation and students are 
dnecied to sikct the Ixst ' synonym from a nuntbei of alternatives. 
I his UK thod docs not itfki t leading \i>cabul.iiy skills as an individual 
applies them in a piactiial ic.iding situation. To determine a student's 
ability tocopi withiKw \oiabuLiiy in context vvouldseem tobetheonly 
leason foi mc.isuiing. Of what use is simply taking a measure of the 
woid bank of a scionda»y student? Goodman (19G8) points out that 
j\oids m isol.ition/' aie paiticulaily h.iid to read because there are no 
gi.imniatK.d chits foi tlu .sentence sti uctuie oi meaning clues fiom the 
context to help ick ntifv the woicl me.ming, yet many sub tests deal vvith 
isolated words. 

I heie aie 30 items on spelling in the Achanced Form. Students are 
asked to lec (Agnize incoriectly spelled words. 
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Ill cvainiiiing nioit t li)j>cl> the i>|Klliiii^ siib-icst, onv lim\s[{\u[ the 
aiuhoi, Bixler, sckxicd the niusi popuLii spclki fui iinc\si^ig.itiiig 
repim'nLui\c spelling lit asbigiial a guide pLtccniuit iii I93G. 

CP. .issigiu'd fui c.itli woid w.is the .nti.igt >c.u iii sdioul .u w IirIi ilic 
words were fii&i umglii. IIii> 1970 (;.P, i.iiiiigs (ui tlu w uids .11 c based uii 
a coiiiiiiiuuioii of books examined. 

Bixlei*s 1970 CP. laiingsfiH the woidsaic basal oiiacumbiiiatiuii 
of his 1956 rating and the "Sptiler Median" lesults. Wuids retaincd^the 
same CP. as in 1956 unless ilie textbook snr\ev seemed to indicate good 
reason to change in 1956 rating. 

The test piibhslieis assiue iiseis tli.u in choosing the spelhng of the 
incorrect items oti the Inteiniediate .ind Ad\aiiced le\eLs, much cau was 
taken to eiisiiie tluit the eiiois weie those conimonl> made in the^pell 
ing of wu)rds. 

According to the piiblishcis of the Metiopolitan Acliic\emcnt l est 
their design for Standaidi/ation w^as as follows: 

li w.imU'ikIuI th.u tiu tn.ijiii iiulix \.ui.il>K-Mu Ix nsdl in st Iti mvvj.iiu! ilcMnb- 
iiig llu' ^t.lIut.luil/Jtl()^ gioup wouUi be the foMovcing. 

[A} tl MX KKtUIlUlIlU ItukvUiUtpOScd of IIU dl.lit f.initl\ llltulill .iiultiuilt.ui >1'.IIS 

of s(!u><)ling foi |)i'iM)ns owi 2 { >c.irs of age 
(b) SUV of city 
a) Ki'ogr.iphit ii'gioii 
((I) puhik non-pubiK ^hooU 
((I) nicni.ii ;il)iln\-ivM sanvs. 

The sociocconomtc index wasconsidereti tu bethc musi im{x^rt.m( nun-test index 
variable since tt !his ihe.highesi relatiun&htp wtth achievement test scores of any non- 
tesi variables whicli have been studiaL Median faintly income and median years of 
schooling were ueighicd so that they e.ich (ontrtbuted about equally to the total 
variance. 

Em h pupil in tlu Mi ttu|xjlttan ^landatdi/atiun, as w i li as in all suppitincntaty 
rc-sean h prtigrains, Uxtk l\n appiopriati lt\U of Otis Lutnun Mmtal Ability I t^t. 
Form J/rhcst data prin uK .inotlui ^uiitct. uf iiifutinatiunuiulR (.haraitctiMusoi tlu 
MttroiMilitau .samph Fiutht-tnu^ii . mutt it v\as.inutipat(.d diat many Si bmds wuidd 
us( IjodiOtis la nnun and M(.tiii}Miluaii ti.sb, tln> juint admniisttaUuii of tlit tists in 
tlu standardi/aiiiiii would suu as an itu(xiriaiU ba>( foi (.ijmpaiiuiL; {x,ifiiiman<.i un 
tlu two tests I'ui pitMcdiiU's usal UKstaiulardiiini^ Lennon Mental Abihty TcAh 
^ sir the Te(hnual Handbook for that sviw^. 

It wasdi'iukd tb.it M(trij|Milittin Ailumnunt lists should Ix statulatdizctl at 
two tinu's in the .K.ultnm >iai, I hisdei ision wasbasttlun iwo fails, J iist.icbtxjlsin 
tilt I'nuniStatts.iit .split .dxiuttt^iiall^ in tuuisufpii fiuna lot bt.j;nuiiH}L;uf>taiiji 
ciul of >iar ttstm^. Siioiul. mt(.T|M)latal noims obuuusly do nut >itld tlx au ur.ic) 
gi\en by anpiiually dttiiiniiud uuims. If a Ust isstandatdiad in du fait and lias tn- 
terixjlateds]jimK nouns, siluxils using du Ust 111 sptaigtaunot us< tluspritignuiins 
with full tonfidimi, l lu .saint typt of prubltm aiiscs \\\\t\i a test tsstandaidi/ial in 
tlu spring aiulgiMs intupolatcd nuims for (In fail 1 kh M(.tio|xditaii, u wasdicidid 
diat thistaiulaidi/.ittuiishoiddlxMHulu(.tcds(.ithat^ilu>ols(.oiddus(. du ust i>iioiins 
wiih (tpi.il (unfulitu( at tlu btginning .uuUrul of tlu >tai. Saili a standaidi/atiun 
pux.eduK has tlu .uldid Ixiu fa of alKiW tnt; sdicKils touitiiiiait tuadunu j^iowtltui 
hxal pupils with .1 national norm within a/singli' acadciini year. 

M(tio{x)lilan wasMandaidiml mOttoWi in tlu fall and 111 A{iiil 111 ilu sjJMtig 
siiut these nuiiuhs sninnl to Ix tlit onis whtit llu vasi majority of itMing isduiu. 
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Sui\i\s i)l ustuit; pi.iuui> iiidii.iu (h.K so luiK usunt; is iUtm <ii imd (hat 
M{itti«Ui >iaiu!.udi/.iiii>it iiu s,i\, nttUhlnioiiiiUii iiiiiia\ss«it> 1 lit uiilv exit puun 
iu(hi>iiiii w.itilu ^uiiid.tiili/aiiiiiiiii ilu IHiiiitt ImKcis til (hi lUKKUt <)fGi.idi I. 1 lu 
,4i<uU pl.Ui iiu iit^ «it whiili uti li i).itU't\ u.is st.iiitl.iuii/od an as follows. 



riu I lull Anal) sis. U hcaich look place ui 1968. Sample pupils used 
U)i iIr iienianalyMshadaua\eiageI.Q. (jf 100 on the Otis-Leiinon Men- 
ial Ability IVsi.' 

Tlu peRi ui iA pupils in Iieui Analysis sample from \aiious ethnic 
categories is piovided by the publisher as follows: 



hthnu X.m\r I'oioiijij 


IHieiio R. 






Ctioiip tioiii U hiK H.tin Whin* 


iNot^ro or Moxuan 


Onenial 


Oihcr 


'A*o!!ACainip: TX2 1 I 


12.0 1 1.8 


1.5 


.3 



,A11 Uhi publislieis punide infoimation as to the school system 
uhuh paitiiipatLS iii pitpubliuitioii restaich piograms (sampling, 
item tryoutSv etc.)'* 



Although the names of s> stems are not the same, there seems to be 
significantly littk diffeiences in the "types*' of communities used 
between the FFBS and the Metropolit»in in the Noitheast area. Both 
publisheis. foi example, used Ncu York City sampling in their 
picpubli(atiiiii piogiam, both used another major city's parochial 
school population — one Syracuse; the other, Rochj^ster. 

The readability of the Mctropolitarl Reading Sub test passage can 
be \icwed through the assignment of "noun grade level.** The publisher 
used Ell> (1969). The advanced forijj of. the Metropolitan for all three 
batteries reports a noun average readability level of 3.36. 

\ ahdit> mii/o achic\einent test must be defuied primaiily inTerms 
of t validity. A ttst has content validity if the test item adequately 

covcis the cuiiiLulum aiea tli.it the test is suppused to evaluate. ESch 
school system, and possibly each school building, has toev<ihi«ite the test 
in light of its own school population. 

New York State Test in Reading, Beginning Grade 9 (1972) 

rht State Manual describes ^he purpose ot this test as follows. 

I in \s ^ ink Sun^i I tsi in Reading. BtginmnK C^r.ult 9. is a M.iiuKirdizalachicvt 
iiitiu tisl iKsi^iiiil (o {itu\i(K inronnaiioii uhict) viU U hclpfdl to school ad 
iiiiiti>tiaiui •> iH i valu.uniK il»t ii J^.il cffti tiv tntJ>J> of ihtii uailiiiH lirogr.mi in graiH 
>t\. M wit aiuici^hu 1 lii> u>t Will hi aJnunisunHiat the iHgiiinint^of ninihgratlcas 
pan of the Now, Voik Siaic IMipil hvahianon PrograuK 

Noniis v\cie not available for this test until the fall of 1973. At the 
iniK of this vMituig dcfnntivL iiiformatitiu oh the new noiming sam 
pling was unavailable. 



Pnnu'i. 
PiiniaiN I* 
Pinn.n\ II 




KlonuiHai>. 3.7. U, L7 
InUinu'diau*: 5.7. 6.7 

Ad\amnl: 7.1. 7J. «J. 8,7. D.l 
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riieTesl in Reading is ba.scd on the it»uling piugiaiii la DuuiKiRkd 
foi New Yoik State schools. It is designed to lueasuie uadiiig coin- 
piehensioii and pKnides oid\ a total scoie. The test consists of II 
leading selections, each of w liich is follou eu h) a nunibei of i|nestions. 
It gi\es a nieasuie of the pupil's abiliu to i tad a.seleuioii ami (o nnder- 
sland it. The (lueslions ttst the »fl)iht> to leeogni/.t the i ( ntial thought of 
a selection, to answ ei questions based on specific btateiiicnts. to make ni- 
feremcs about the con tent of a selection, and todisio\ ei the meaning of a 
word fioni its context. • 

I he test contains 30 nndtiple choiie (luestions and rcxinnes 50 
miimtes of testing time. 

The oiiginal Grade 9 test uas set np to identify pupils needing 
special attention, to discuminate among pupils wall marginal skill. 
The new form of the test is designed to couelate u ith the Giade 3 and 
(Jrade 6 tests. 

rhc readability based on the Flesch ease fomuda and the SMOG 
. fomuda determines that theieisascxiueiitial difficulty in the 1 1 passages 
langing from approximately 5.0 to 10,0 in grade level. 

Of the three tests obscncd thus fai, the New York State Rea(hng 
l est has less distortion of tasks and fcuci word isolation pioblems. I he 
leading passages, houe\ei, canbechaiak.teii/xda!)bcingsimilai to those 
of the ITBS and the Metropolitan, diereby , raising the same concerns foi 
selection of ^xissages. 



Knglish staffs must leiogni/x the severe liirutations of standardi/.ed 
a(hie\ement tests foi the purpose of assessiiig^owth of English and 
leading curriculums. 

These tests du not measure the student's ability to use the tools of 
language, to inveu^t. expand, substitute and tiansfoi m sentcncesoi ide.is, 
to lespond to liteKituie, to act as a clarifiei of fact and opinion, to be <i 
cieaior with uoids, to behave as a user of images, an airangei of new 
gioupings in tlu use of language, oi to geiiemte language and literary 
altt^rnati\es. These tests measure cognitive skills, basically at the 
knowledge level. Phey do not measure progiess. 

though theie aie severe limitations, English staffs cannot ignoie 
.some usehilness of the information. 

Siandaidi^d tests may serve as a useful barometer, as one compo- 
nent of an e\aluation model foi a school distric t. I'hey ha\e less validity 
at the building level and even less at the classroom level. 

A final note about the puipose of standardized testing is stated 
piecisely by Ronald J. Sanuidn (1973): ; 

III tlu final analysis wi mid tt> look at puriAmsof tisimgJf ttsuu^ isioscrvi-aM-la- 
UM" and soiiini^ fniuiu>n. and if. indml, psulHinictiu tti liiitiloi^> is initiidal {a 
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preserve an elite, Ukii ii lollows iradilional proccthires for measuring in 
lelligentc and stbolasliL apmudt, iieU to a iel of niuldle class cihnoceniric norms, 
will serve lhal lunUion vtr\ utll. However, if it is our purpose lo ^erve the mass of 
niiiens, and il it is oui giMl to makt ineasarenitni more facdnative for the education 
of ihc|XKK, ol lilt iniiioiii> sluddU.andof llital>piLal individual, then wc will need 
to expand oui rescaith endeavours so that ps>choineirii. leehnology becomes the 
handinaideii of eduuiiional innovation in opiimumg the individual's comixrtcnce 
Ihrouijh the i|iialitativ(. analysis of achievement and weaknesses, we can point the 
way towards the nuxlifuation of patterns of instruction which will match the in 
div idual needs of indiv idual students. It is therefore the hope of sjth a philosophy of 
testing lo Lontribuit to the athievement of optimal developmental and educational 
op|K>rtunity for all. 

Isaac E. Young Junior High School 
New Rochelle 



tnKlish and Knglish. A Comprthmsivc Diclionary of Psychological snd Piychoxiuly^c Trmu. 
Mil ihrcf ir^t publishCTS ( iird in (his nvclc give citar. advice as lo ihe limiUlions. 
Tublisha's difcciions 

*Mfa«|H>liun Athiooncni Iwts Spcttat ReporiS. Tot Dfpaiunmt. Ilarcourt Bnce. Jovanovich. Inu 
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The Regents Comprehensive 
Examination in 

/ English: Some New 
Questions and Some 
Tentative Answers 

by Lee Odell 

Coming as a "final measure" of students' ability to think and com- 
puM% the Regents Comprehensive Examination in English ought to 
pruv idc us w ith as much insight as possible into students' mastery of the 
processes of composition. Unfortunately, the exam does not do this. It 
cannot. As it is now constr^icted, the ''composition" section of the exam 
forces us to ignore much of what practical experience and ihetorical 
theory tell us about the nature of the composmg process. A close look at a 
Regents Exam essay, cited in "Suggestions on theHatingof Regents Ex- 
amination Papers in English" as an example of superior work, should 
help explain the predicament. 

G.idgcisl Wlni ailcvir. >ct .it I- inclusive word this one is» Wht'ii nvc hear it wcarc 
unuiuU'il uf iU'mlcs vvhiLli afkct air 'jbt ovory pliase ul niuJcrn hving and uhich 
range (rum the \u\\\) jatkknde to t^^c tnghtv sensitive elixtrit^ eye. It is only aftei 
laiefiii reflixtioii ih.tc uah/i. hi>w muchtictiud infKientc tliesi devices haveoiioui 
ciiiily lives. 

I* list we shuiild .tpprect.itc the wide diversifieation of interests which gadgets 
serve. During the course of the day» wecncounter gadgets at cvcr> turn. In the kitchen 
wc find iiLW type L.ni 4;|}ciKrs. .ipplc curers, .iiid cabb.ige choppers. Mic refrigeiati>i 
has lun (.M.t{>c^l ilu uiuntiu uigc of our g>ulgct scientists, lights to tlluininate its tii 
uiior, ami pi.isut ac cube lioUlersniciki the housewife's tasks easier. Our cai sale dis 
lingutsl.vd by autoniauc ihrixlion 'iidiiators, window wi|>ers. suction-typc ioM 
li.tngcrs. I udy wc h.ut uhir to reg.ird g.tdgets.dmost. is. i part of up-tonlatc living. 

It IS tins "up-to ilate-ness" th.it is .mother form of the Kix'p Up With Tlu' 
JoiKsis spun of in.uiy Anitriiaiis. 1 lie publjc s devotion tuin.iii) f.uls.ind w hims is 
now ^uppleineiual by iIk pruviKattvi .ippc.d of g.idgits of ivciy desuiptioii. Il is 
soini times then pr.imial .ippi.tl wlikh c.iptiv.itis the c.ii buyci who ailiniies tlu 
iii.uty dcviLC^'k which ni.ikt diiuiigi.isier, more often it isliisdisirt topioudly displ.i) 
the latest in gadgets. !Ieie is the ronipl.icency of a Babbitt .U iis wntst. 

Is It not trui too ihat gailgcts rtsult in our di}K'iuleiUi u|K)ti (lum? Wc ful losl 
w tdioui ihtin, .iiul ihauoiihdiuig is missing fioiii tin tuuipK uiuysof oui d.iy.U hu 
h.i'i nol ft h .1 sciisi of niaiUt|uaiy vsIkii ht fmds (h.it uir of Ui^ f.iuMiU g.idgits is not 
(lUHtioning properly? 

Ifc.iluc my ixniU of vuw is not .1 usual out, but kt llu li.idii ask liiniMlf .is I 
have. Ale g.idgels leally as insignifi(ant .is we think? I woiulei. 

The peisona cieated in "G.idgets** is that of a |X)lite. rainest but 
lalhcr anonymous college bound student \^fhing for an <tuclience uf 
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poliics collcgc-aluc.ilal iidiilts who— tit ka.si for puipusi'.s of llii.N 
c\.iiu -\*ikic u riling iluii dispKi>s ti ptUtituLir .set uf st>lij)tic fciitUK.s. 
riicic tiK nu inisspcllings iIku uuukl iiulic.ilc he .spells piiuuLtit.ill), 
Luk.s kiumlalgc of spelling inks obscnal b) iiKin> of hi.StiiKliintcoi io 
kiting his !iiind \\«nuki iiiul f«iiling to pioofu-«ul his woik. In .iddition, 
tlic spCtikci lonibinv.s stntcnecs in Mthti couipkx \\d)s, hcjoni.scKiuscs 
with colons .ind semi colons, .ind his .scnicnccs conttiin *! faiil> Lirgc 
numbci of cnibcddcv. chiuscs.-Hc chooses words thtit .nc icLiti\cl> in- 
frcqueiit in tccMuigcrs' casiud con\crs.ition, e.g., he lefers to .i "wide 
di\ers/fic*ition of interests'" i.ithei tb.ni to' lotsof diffeient niteiests." In 
sliort, his wiiting exhibits in*in> of the ch.irtictci istics Engli.sh tcMchcis 
are likeh to value. Moieovei, the peisona seems mildly pio\ocati\e, he 
asseits a point of view that, he cLiims, not everyone .iccepts, but the 
questions lie raises ceitainly do not ch.dlenge his .ludienee's basic <it- 
titudes or Vtdues. lie is argument.itive without being abrasive. 

L'n(|uestionably , the w liter has cieated «i persona th«it i.s ap- 
propriate foi his tiudicnce. Tsing thirty points as the highe.st possible 
stole, juilgcs indicated they would.iw.iid the essay twenty -eight jjoints if 
written by a junioi. oi twenty -seven point.4 if written by »i senioi. 
ruillicrinore, the essay iscie.nly .super ioi, in some respects, toothei sam- 
ple essays th.it accompanied it. Given the limitations imposed by the 
exam, the student has piob.ibly ilone as much as we have. my right to ex- 
pect. Vet the essay piescnts sevci.d sci ious pi obleins, problems th.it h.ive 
more to do with the n.iture of the "composition" section of the ex.im 
tlian with the quality of this .specific essay. 



For OIK thing, the ex.iin precludes our determining vviiether 
Sly listic fe.uurcs of the css.iy reflec t .i series of conscious choices oi simply 
the rote .ipplic.ition of stylistic foinml.ie. I would like to believe the 
former is tiuc. But my experience te.iehmg composition to high school 
and uinveisity suidentsdoes not piov ide much b.isis foi_^such an assump- 
tion. StUilent.s cm be inciedibly inflexible about in.itteis of style. Once 
they h.ive learned th.it a givensty listic featuie is effective in some con- 
texts, they often .issume ti^at the fe.ituie is inherently good, .ippropri.ite 
in all contexts. 1 oi such students, wiiting .m ess.iy simply ine.ins follow- 
ing .i limited set of cle.iily defined lules. On the b.isis of wiiting elicited 
by the piesent Regents Ex.iin, we h.ive no way to decide whether oi not 
I lie writer of ''Gadgets" is one of these students. 

A second problem, one which perhaps causes the first, is th<it we 
liave no w.iy of knowing whether the writer of "G.idgets" c<in cie.itc 
other persoii.ie or .ippeal to other kinds of .ludiences. We do know th.il 
this writer cm Iiave a desired effect on . n audience of English teachers. 
But ^vvc .il.so know tli.it once college students finish freshin.in composi- 
tion,, coinp.ir.itiv ely fev\ of them ^aiid fewer e.ich ye.ii ) speiul much time 
w riling essays to be lead by Englisii teaciieis. R.ither, tiiey begin piep.ir- 
ing for ciieers th.it will lequiie them to communic.iie witli people 
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whose batkgiouiuls. \.ilucs, and iiucicbib \.u> widely. I hen piaciiud 
experience in iiying to communicate with these di\cibc audienccj, tells 
ihein what ihctoiital theoiy and training should ha\e tuld them all 
along: To (omposecrfecti\el> one must be able toereatea\ariety of per- 
sonae that w ill beappiopiiate foi tht \ aiious audiences one cneounters. 
Sophisticated writers arc those who can make difficult stylistie choices 
based not on ,i simple standard of "correct" and "ineorre'ct/' but on an 
undeisianding of the complex lelationship between the pcisona they 
wish to create and the audience they wish to address. The student who 
wrote "Gadgets" may ha\e achieved this sophistication. But the exam 
does not ask him to do the sict of w ork that will let us find out w hcther 
he has or not. 

Another difficulty is that we ha\e no idea of this student's ability to 
compose with non \erbal language. We can't tell w hcthei he can choose 
the movement, posture gesture, and facial expression diat will be consis- 
tent with the peisona he's ti\ing to project \crbally. Noi can we dctci- 
minewhediei he (an use the body language that will help build rappoit 
wiili, rather than alienate his audience. 

Finally, ■■Gadgets " pio;ides only ^little infoimation about- the 
student's ability to engage in useful pre-wiiting processes. On die basis 
of tlieconipleted essay, wecaii makesevcial iiifcicnccs about the thought 
processes die writer used in examining his subject. He laised scveial 
ciuesiions, (onipaied present day dependence on gadgets with di.it of a 
fictional cliaiac ter, and coiisidcicd severaU^uJses of people's iiiteiest in 
gadgets Sine e the time al lotted for the exam had to be div ided among ex- 
amining his subject, wiitiiig a draft, and editing, we have no way of 
knowing wlictliei the w liter could have used these piocesses more 
ihoiouglily. ( That is, (ould he have raised other interesting cjuestions 
legaiding the topic? Could lu have thought of otliei significant causes 
for people's dependence on gadgets?) Xoi do we know wlietliei the 
writer had suffic ieiit conscious mastery of these piocesses to use them in 
examining the complex, problematic matci ials he w ill ha\c to deal with 
ill-college and in his career. 

Toward a Revised Understanding of the Process of Coiiiposition 

Until comparatively recently, it would have been difficult to argue 
that these problems do in fact exist. Must popular composition texts 
published over the last fifty ycais lia\e led us toec|uatc effective composi- 
tion w ith adherence to what one such text calls "practical prescriptions 
foi good writing." These tex us, epitomized, by Stiuiik and White's The 
Elements of Style^ and Waninei's Ilandlhpk,^ make no reference to 
noii-veibal language and piuvide almost no insight into processes of 
|. !e-w iiting. M best, tlu se woiksgive useful instructicjiis for ci eating one 
kind of pcisoiia. At woist, these texts offer only what I. A. Ricliaieis has 
called '*tlie usual postc aid's vvoitli of ciude common seiise."M*oituiiate- 
ly, the extremely liniil<duiidciStandiiig of composition impliedm these 
texts has been expanded duiiiig the past sevcial year.s. A number of 
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wiiuib ha\<. ciilaigcd uui iioliun uf the process of composition lo iii- 
tliuk maiurs ih.il \vc have coiuciuioiialK ignored or relegated toother 
(Use i pi i lies. 

Speaker and audience. In Poinh of View^ James Moffett and 
Kenneth R. MtElheney describe different speaker-audience 
lelationships that ma> exist in narrative piose. Selections in the text 
show hou usage, diction, and syntax change as one moves from ad - 
dicssing an immediate, sympathetic audience to communicating with a 
lemote audience whose feelings, ideas, and experiences may be quite 
diffcient from oiu's own. hi Persona^ Walker Gibson examines the 
different voices that may exist m apparently "objective," formal, non- 
fiction prose. He points out, for example, that even such a "staid and 
rcsjx^nsible" publication as the New York Times may exhibit several 
different personae— ranging from the speaker in a news story, who 
tautiously icportsonly what "officials said" and tempers conclusions 
with ' appaiently" and "allegedly," to die authoritative editorial page 
^pcakeis who pionounce \alue judgments and assert debatable con- 
clusions, to the assuicd, informed, witt) persona displayed in a feature 
or background story. 

Neither Gibson nor Moff^tuuid McElheney would argue (hat their 
ideas arc without preceden^. In fact, Gibson is especially careful to 
describe his indebtedness^to Aristotle and cl.*ssical rhetoric. Work done 
by Moffcu and McElheiiey and by Gibson is important not simply 
because it may strike some people as completely new. Rather this work is 
important because it provides (in part, perhaps, reminds us of) 
rhetorical theory that allows us to go beyond the narrow view of com- 
position ^ugf^ested by Strunk and White and others. We can no longer 
equate "appioximate perfection in technique of compositl^.i" vvith the 
ability to create a single kind of persona that is appropriate for only one 
kind of audience. 

Our understanding of the process of composition has been further 
expanded by recent work with non-verbal language and by studies of 
pie-wiiting processes (hat help a writer examine new information, past 
experiences, personal values, etc., in an effort to formulate the ideas he 
will wrue about. We no longer need be limited by the assumption, im- 
plied in the piescnt Regents Exam, that composing is chiefly amatterof 
drafting and editing, i.( ., of writing out and revising one's ideas. As was 
the case in theaigumcnt based on Gibson's and Moffctt's work, daily cx- 
peiience. .i5 well as theoiy, argues for a change in our thinking about 
composition. 

Son-verbal Language. Weshouldn't neecl a social scientist to tell us 
that: . 

Cx)ininuiiu.Jtu)M is a tmi\nuuiiN inU'i.uuvc process in.ulc up uf inulti-lmlcd, 
u\rilMppinK.ilisL6niuuimiJ>K'j^icn The inUTacUunufioinmunR.uioii 

iiws not ttUt ulu'M iiiu'MLUims I.ipsc imu sileiu-c. to begin again uuli the onsfi of 
phonaiion, otiui tlianntU iijnunuc Lonnnunitaiiiin operations v\p\ when the 
amhiury'auralchaniulii>iujt in im. Humans mou tn rtlaii\el> ordeil> fashion whik 
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llu) KH.ili/i ami uluii cluy .ni siliiu, ilu> can ptutivt tin Kgulaniy in llu Msibh 
imnoinont of olluij>(oi ai liaM Inionic auaii uhcii it irugiilauaiKi pio|>iiiKt*pii\c- 
l> in itu'insrlvts Thv) laii snull, lasu. louih aiui oiluivvisi itj;isiti pcutpUon o( 
(homsclvc.^ aiul lluii siiiiuuniiin^s Wlun u;i;ulanitc'5 apfxrar. ihv) art* noi >inipl\ 
intthanual, 'aiuoinalii/ oi liappi nsianiial R(5,tai(li uiih msiMi Ihx!> iiiution ii 
(oniiiu inj; tiMhai lUis khavior isasoukuiiaiiiiuxlcda^ isamlibk pliunaiioii. Iak( 
languag(. infia loiniiutnuattuiial Ixxi) niotu>ii is a stiuc(iiuii.s\^Kin iliai vaiK^froni 
sin 'my Iosihki> aiuInuisilH kaiiiid In tlu iiKinUi^hipofasiKKi) if n iMwinicrau 
MKCi'ssfully,' 

Hav ing to struggle with a soci j1 scicniisi's jargon is pahapsoui punish- 
ment for ha\ ing disrcgdrded the substance of his message. The point is. 
effective, catefull> consideied use of non-verbal language is as im|xjr- 
lani a part of communication as is careful choice of diction, synttix and 
usage. 

A conventional response to this point is to acknowledge itsvalidity 
but relegate non verbal language to the realm of speaking rather than 
writing. Such a i espouse implies a distinction between speech and 
writing, a distinction thatdoes havesome basis in fact. There are ways in 
which certain kinds of spoken language differ fioin certain kinds of 
written language. But an interest in composUton (a term I think we 
should not equate with the more limited term ivriiing) is not always 
well-served by this distinction. It obscures the fact that many kinds of 
coinmuQ^cation which we often think of as "written" imply speaking 
and writing. Narration and dialogue imply people talking as well as 
writing— taTldng not only with their voice but with gesture, facial ex- 
pression, phy\cal appearance. Even analysis and exposition— in the 
form of lectures, reports, presentations— may exist in both a non-verbal 
and a verbal medium. 

Most of us, I assume, have suffered through courses taught by 
professors who ignored this last point. These instructors' lectures— 
monotonously delivcicd by what seemed to be a disembodied \oice that 
could cure the severest case of insomnia— should helpsupport my argu- 
ment by contrast. Certainly, the point is not lost on those whose 
livelihood depends upon their ability to persuade or influence others. 
Since polls indicate that politicians, lawyers, and advertisers— formerly 
goocl sources for illustrations of my point— now enjoy somewhat less 
public confidence than they once might have had, I'll give an example 
from a rather unlikely source. When the United Mine Workers recently 
sent men into the coal fields to encourage workers to accept a newly 
negotiated contiact. they did not send bureaucrats, adininistiatois, 
lawy crs, or any body w ho looked as though he earned his hv ing by sitting 
around an office. Rather, TV newsfilm showed miners listening to 
rugged-looking types— solid, sturdy men whose gestures and 
mannerisms did not appear to be those of the carefully trained pubhc 
speaker, men who wore open neck sport shirts, jackets (rather than sport 
coats) and slacks (not work pants, but not Brooks Brothers tailoied 
slacks, either). Their pel forrnancc atcurately if notconsciously, reflected 
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Ai isioilc's puim. uiK iiiipui um i cause uf pcri>udsiun ij> the "character " or 
eiliusV uf tin spcakci.'^ In this day uf \ihuai media and reliance on face- 
lu-facc cuniimmicaiiun, pan of thai ethos is established by nun-\( .* a! 
language. 

One may argue that students need tu btable tucompuscasiaiemcni 
that IS cleai and cffectnc even when not actually accompanied by non- 
verbal language. I agicc. Students will frequently encuunter situations 
in which tins is important. But at least as frequently students will be ex- 
pected tu cuinpuse messages fur a dramatic context in w hich nun verbal 
.language will influence the meaning and the effectiveness of their 
message. In this latter suuatiun it seems shurt sighted toargue thatcoin 
poMiig entails unly selecting wurds and syntactical patterns. These ver- 
bal choices derive part uf ihcir significance from the nun veibal context 
m winch they uccui. If nun verbal language — e.g., that uf the archetypal 
iiicpl Icctuiei—subvcrts ur ubscures the message intended thruugh word 
choice and syntax, u i.-^ hard lu argue diat the sender of the message has 
achieved real skill in composing. Since many modes of 
cuinmunicatiun— narialiun, dialugue, exposition— rnay entail non- 
verbal as well as verbal language, andsince thequaliiy of the non-verbal 
language may affect diecjualiiy andeffecti\enessof the verbalmcssage,! 
iluiik we have a very eunipelling argument for including non-verbal 
language in our teaching and our evaluation of composition. 

Pre-iuritin^, We alsu have guod reason to think that pre-wriiing is 
an unpurtant, measuicable part uf ihe composing process. We would 
nut, huvvever, diseuver this reasun in many of the composition lexis (by 
Sirunk and White and others) that have long been used in many 
classrooms. These lexis tend to assume as the writer of one such text puts 
It. the siylisticside of writing is,in fact, theonly side thatcan beanalyz- 
ed and learned. ""^ Consequently, ihey have emphasized matters of usage, 
sentence suucture, diction, and organization, and they have paid vir- 
tually nu attention to the problems of how we examine information, 
clarify our ideas, and discover what it is we wish to say. 

rile hmilatiun uf these texts is made apparent by ancient and con 
icinpurary tluury. In his Rhetont Aristotle acknowledges that highly 
specialized types uf leasunmg nmsi be treated in disciplines other than 
ihetuMc. Vet Ins work clearly mdieates that Aiistotle did not concern 
himself unly w uh airangeincni and sty le (concerns that have, in ihiscen 
tury, preoccupied authuis uf many composition texts). Rhetoric con- 
tains a gicai deal of mfurmatiun abuut how one explores a subject and 
fuririulates the ideas he wishes tu communicate. Widiin the past decade, 
this miei est in the piucessesof discovery has been revived by aniimberof 
writers. Some, like Edward P. J. Corbeit, have been guided by Aristotle's 
theory . Others,, such as William J. J. Gordon and Richard E. Young and 
I iank Koen have drawn upon recent work in creativity and language 
study. All uf these writers suggest ways we can do more than simply ex- 
hurt students tu think carefully befurc they begin to write. Without 
ininimizing the irnpunaiue of nun eunsciuus, intuitive processes, these 
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wrilm have show 11 lis how w( i«iii h( Ip htiulLiitMliicct thc'ii thiiikiiii^ by 
dealing "esseiiiiiil (lcfiiiiii()iis."'Scckiiig.iii.ilogic.s.^^ .iiul iii.ikingcoii- 
scious use of ccruiii iiilcllccliul piotmcs.'- Whcihci avc .ire asking 
Miuleiils to ex.iiiiiiie (Oiuplex new iiifoiiiulioii oi le-exaimne f.iniiluii 
topics, we can help siiicleiils iiusiei piocechues that will let them do 
itiore than jnst sit and jwait foi inspiration. 

To\^ard Revising the Exam 

As we revise oiir iiiiderstaiidingof the natnieand picxesses of toni- 
positioii. WT increase the uiimbei ul interesting coinposiiig aeti\ ities we 
can haveoiii students do. But we also inci ease theiuiinbei ol pioblems 
WT have to solve when we tr> to lueasuie students' giowtli in composi- 
tion I'hepreseiu Regents Mxaiii in Composition lecpures us todeal with 
one basic question. I low do we ineasiite students' ability to wiiteontaiid 
edit a statement in which tliev create a peisoiia that is appiopiiate for 
one kind of audience? i*lieo!> desci ibed thus fat foicesus to confi out dif- 
ficult new qiiestions: Mow do we measure student.s' ability to make 
stylistic choices appropriate to a \a!iet> of speaker-audience 
relationslu'ps* I low do we design an exam that w ill help us fiiidout how 
well students can (ompose with iioii-veibal languageP l Iow dowegetat 
intellectual activity that goes on during the pre-wiitiiig process? 

In part, these questions ate intimidating simply because they ate 
coniparati\c*l> new. \Vliate\ei its limitations, the pieseiit exam presents 
pioblems that aie familiai, we at least lia\e the satisfaction of kiiowiug 
what sort of hustiatioiis we will entoiinter when we dunk about the 
exam. New questions implv a new oi 5ubstaiitiall> levised ex.iiii, and 
this, in tuiii. implies a new set of fiustiations foi us to deal with. This 
prospeci i^ almost enough to make us content w itii the ver> lumted no- 
tion of composition implied in preseiit-exains. 

This coiiteiitineiit, liowe\ei, comes at a \ei> high price. It lequires 
that we forfeit a reasonable understanding of students* ability to com- 
pose. Moreo\ei. a desire foi this contentment may lead us to igiioie the 
fact that classroom piucdccs. combined with the tlieoiy ahead} desciib- 
ed, begin to suggest some useful wa>s toaiiswei these new ciiiestions. l oi 
example: It is fairl> coiiinioii to find Liiglisli teaclieis assigning two 
diffeieiit kinds of composition. In one, students are asked to aiialy/e 
what soiiieoiieelse has composed. (i:.g.. Discuss tlu toiieoi point of view 
in a given slioii siou. Kxainiiie the wa>s an autlioi creates his cliaiacters. 
Vssess tlie\.didit\ of the aigiiuu iit dt \( loped in an editoiial, ad. speech.) 
In a second kind of composition, students aie asked to show their own 
ability to create a persona, appeal to an audieiue. and examine some 
subject other than a literary work. 

riie distiiu tioii between these two kinds of assignments is not, of 
couise. absolute. Noi i,> it adequately reflected in the custoiiiai> distinc- 
tion between creative and analytical wiiting. Any writing may be 
creative in that it reflects an attempt to come tcja new understanding of 
ones self, one's audience, or one's, subject. These reservations 
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noiwiihbiamling, ihcdisliiicliun seems useful. Both kinds of composing 
are important. And the ability to do one sort of composing does not 
necessarily unply the ability to do tlic other sort. Consequently, thisdis- 
tuRtion will hel|) shape answers to the following questions. 



How Can We Measure Students' Ability To Create Different Personae 
and Appeal To Different Audiences? 

A partial ansu cr to this question may be suggested in an assignment 
one teacher uses with eleventh and twelfth grade students. He asks 
students to choose from a list of uaurpatic experiences (e.g., you put a 
dent ui your folks' car, you're accused of cheating) and do two pieces of 
wntuig about Uuuexper'aice. In die first, students are todescribe die ex- 
perience as Uiey \sou\d in talking to a close friend who diey know will 
sympadii/x'uuhdiein. In die second piece of writing, studentsare to talk 
about the experience as Uicy \\ould to a more remote, less sympathetic, 
authoritarian figure. Students' interest in and success with this assign- 
ment suggests thai die exercise might serve as a model for one sort of 
composition test Item. In place of simply posing a topic such as amnesty 
for draft dodgers, ue might ask students to take a position on amnesty 
and present that position to, say, the VFW and to a group of anti- 
military college .students. In such a case we might ask students to explain 
die persona diey w ish to create and to describe their assumptions about 
tlie values and attitudes they associate with each audience. We might 
tivaluate the two pieces of writing by determining whether word choice, 
syntax, usage, and umtent are appropriate to the speaker audience 
relationships students have described. 

Another, more analytic format is suggested by work Stephen Dun- 
ning has done with ninth graders.*^ In an effort to get students to ex- 
amine poetry more closely. Dunning has given students diree versions of 
die same poem—the published version and two revisions in which he 
lias altered dicuon, syntax, and metaphor. By comparing and con- 
trasting spe' ific feauires of die diree poems, students are to determine 
which poem is the original. Using Duiining's basic idea, wemiglit pre- 
sent students u ith iwo or more versions of the same prose passage. After 
describing the persona created in and the audience appealed to by the 
original passage, we could ask students to identify the original passage 
and cite specific features that helped them identify theorigiiial version. 

lo combine analytic and creative work, we might provide students 
with a description of the cliaiacteristics of a speaker and tlu* audience to 
be addiessed. We might then ask students to examine a piece of writing 
diatdoes not leflectthc persona we have described and is not appropriate 
for die intended audience. The students* job might be, first, to identify 
those features that are inappropriate for the specified speaker and 
audience, and, second, to revise die jjiece so that it creates the intended 
persona and k appropriate for die audience we have described 
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How Do We Measure Students' Use of Non-verbal Language? 



In answering this question, it seems useful to relate non-\eibal 
language to considerations of speakei and audience. For an analy tie test 
item, we might select photos (fioni ad\ertiscments or fiom acollectioii 
of phologiaphs such as The Family of Man) in which a nunibei of rion- 
\erbal clues suggest a peison's state of mind, attitudes, personaiiiy. 
Students could be asked to list the noii veibal qualities that allow some 
understanding of the person depicted in the photo. To combine analy tic 
and creative work, we could present students with a picture in which 
non-verbal language creates a persona that is appropriate for a given 
audience. We might ask students, first, to identify the non-verbal detail 
that helps make the persona effective for the nitcnded audience and, 
second, to list non verbal detail that wuuld modify thepeisona so that it 
would be attractive to a different audience, hi evaluating studentsvv ork 
on eitlier of these test items, we might score students' answers on the 
basis of the specificity of their answers, their ability tociten^orc than one 
kind of detail, and the relevance of specific details to the intended 
speaker and audience. 

How Can We Measure Pre-writing? 

Different prewriting procedures may require different ways of 
testing. Rather than trying to devise ways to measure si:>ecialized aspects 
of a single set of discovery procedures, it seems more, useful to suggest 
ways to examine students' mastery of more readily accessible aspects of 
several pre-vvriting systems. 

Creating Essential Definitio7is*\ In his Classical Rhetoric for the 
Modern Student, Corbett explains Aristotle's procedure which 
"designates that which makes a thing what it is ahd distinguishes that 
thing from all other things.'] (p. 10) In dealing with a topic such as 
"gadgets," Corbett would tella student to identify a specific gadget *md 
1) specify what this thing has in common with all odier things that 
belong to tlie class "gadgets" and 2) specify the details that set this thing 
apart from odier members of its class. An examination item based on this 
procedyre might ask students to list the details that their subject has in 
common w idi other membeis of its class of things and dicn to list details 
that make it unique among members of its dass. 

Creating, hialogies. Although Gordon did not specifically develop 
Synectics as a pre vviiting procedure, one of Synectics' basic activities- 
looking for unusual analogies or metaphors— is obviously a useful 
means of clarifying one's feelings about and understanding of a subject, 
An exam item might ask students to begin examining a subject by 
creating as many metaphors as possible. A student dealing with 
"gadgets," foi example, might identify indiv idual gadgets and compare 
them widi animate objects. Oi that student might consider sub-topics 
such as people's need for gadgets, people's use misuse of gadgets, the 
limitations of gadgets' usefulness. The student might then list all the 
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ua>s lu' uui ihiiik of ih*ii, fui example, people's misuse' uL gadgeis 
parallels their iicainicm of other objects oi of people. 

Posing Questtofn. Among other writers, Richard E. Voung and 
ritiuk Kocu aigUL that iht m\Lstigatiuu of a subject begiris with one's 
auattiuss of ti dissuiuiiiLC, «i sense something is tiuiissoi not c|uitc light. 
Since this dissonance uui) be cxpiessed *is*i ijuestion, Voung .uid Koen 
aigue that oni s ability to txploic a subject thoroughly may hinge un 
one's ability to po^se and rc foinndate questions. They argue that an es- 
say consists of ones attempt to exploie and answer the questions he has 
posed. Agiecmcnj with this piemise might lead us to ask students to 
picfact their writuig by listing as many ijucsiionsasfjossibleconcemmg 
the to[>ic they'ie exauuning. After a specified time, we might ask 
students to look o\ci the list and eliminate or re formulate questions 
that do not seem pUKluuivc. Fhcy might subsequently write essays in 
whiih they attempt toaiiswei the iiucstion(s; they have forniuKiied. As 
an alterntitixe tu this procedure, we might ask students to examine a 
piece of prose m which a wiiicr ex.miinesa topic nuher superficially. We 
might then ha\e students hst significant questions which the writer 
appeals not to hti\i considered and write iheii own css*iy on.lhe basis of 
questions not answered in the original piece. 

Listing details t)r questions or analog^ies is, of course, only one pari 
of tlu process we want to m\ est igate. Thus it seems inevitable thai a list 
of items would be followed by a short w litten passage in w hich students 
showed the icsults of then tittempts to explore a siibjfxt. Given the 
limitations of the students* time and the careful focus of our interest at 
tins point of the exain, il seems unfaii to consider matters having to do 
with speaker and audience. We should probably be well advised to 
o\crlook featuies of diction, synt*ix, etc*, unless those features obscured 
students' efforts to explain tfieir idcMs. In reading the es ays, we should 
piobably coiuein ourselves w ith one basic cjuesiion. Have students been 
able to select frenn all the inforinalion turned up in the pre-writing 
fnocess those items that wdl let ihein present a coherent, thoughtful 
statement? In judging the lists of items, we might consider two ad- 
ditional questions, hllow many items dt>cs each student list? 2) Can the 
studtiit listiiioic diaiione kind of item? Quantity and diversity of items 
are not, of couisc, sufficient to insure a perceptive essay. Fhcy arc, 
howe\ei, necessary and worth considering in our evaluation. 



In one of his early books, John Holt tells of playing Twenty 
Questions wuh clcmcutary school children. Eventually Hoi t*s students 
learned to rcpLict wild guessing wiUi systematic questioning that 
sought to naiiow the field of inquiry by eliminating certain possible 
answers. Confronted with the problem of tryirig to identify a specific 
number between one and 10,000, they learned that "Is it twenty- three?" 
IS a less useful initial question than "Is it between one and 5,000?'* 
v^lthough pleased with this progress. Holt reports another problem at 
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least as serious as tomploic reliance on guess\Nuik. Moll says thai if lie 
res|)onded to the latter question b> say iug " Ye.s. the nunibei is between 
one and 5,000," students would cheei. But if he said "No," students 
would groan in dismay. Ahhough eath answer isecjually niforinative, 
his students "still cling stubboridy to the idea diat Uieoid> good answer 
is a yes answer .they have not learned how to learn froiii a mistake, or 
even that learning from a mistake is possible."^^ 

Although the questions we are dealing with aie infinitely more 
complex Uian those I lolt posed to hiselementary school students, Holt's 
story seems uncomfortably pertinent. If we try to pursue these questions, 
It seems only fair to assume that we aie beginning a process which wdli 
at least nutially, be characterized by mistakes and unexpected, un- 
satisfactoiy answeis. In her criticism of the Regents Exams, Patncia L. 
Speyser argues: "Anyone who criticizes an institution is likely to fuid 
himself criticized for failure to be constructive unless he also makes 
suggestions for its improvement, but I leave that work to diose who have 
less confidence in die intelligence and competence of English teachers 
Uian I have."^^ In essence, I. agree with Speyser's assumption. English 
teachers do have the intelligence and competence to make die needed im- 
provements. But diesechanges will comeslowly, perhaps painfully, and 
only with tlie combined effort of classroom teachers and reseaichers who 
realize they have learned someUiiiig wIkmi tlu-y find out conclusively Uiat 
die answer diey aie seeking is not between one and 5,000. It may be diat 
answers suggested in this paper falfinto diis category. In any case, I look 
forward to the next effort that perhaps will tell us that die answer is not 
lower than 2,500 or higher diaii 7.500. 

'ShiiKliii B.ika. Thf Pratiital SiyVw. tVhid nlm./n <NV*\* YoiV. VM). p HI 
-WiMwiii SuuiiV. Ji . and i B Wliiif. Thr Elrniems ofStylf CNcv* Yoik. I'jyj) 

>lt» ^ U..,nn,r arU U^nr^ Griffith. EnRl»h G.ammar and Comp(«.i.on; A Compltir Handbook uNch \mk, 

•I A Ruli.irtlv.The Philu«>phy of Rhfloric (N>x> Yoik, i%Sup 8 

Mofkiiand Kninelli R MtKHirm. ixU . poinu of View (Nti* Voik. l*M}fi) 
♦U.ilVu i.ih^m. Persona; A Sl>lrSiudy for Readers and Writers <Ncw ^oik. VJt^ 

Kjs »udu UiMvU Kinc^u V ' Iniernalional Enc yclojxdu of ihe StKui iHierite*, \ .iu,incM*Nev. ^ oik. imK P-3)"» 
■^rhe Rheiorit of AriMotle. umw l^nc(;<y)iHi iSvv, York. \%0}. p 8 
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A Proposal for a Test 
in English for 
Students in Grades 11-12 

, Robert Carruihors 

OVERVIEW 

Most ttMchas of English in gudcs 11-12 arc familiar with the 
topical ' dassioum test foi students in these giades. The test has a for- 
mat aiul st\k uluch has become traditional and, to some teachers and 
Mudents at least, uininaginativt. (This does not mean that the test is not 
\ahd oi leliable, ho\\e\ci.) The same sections— vocabulary, library 
aisage. hpelhng, giammai. etc.— inarch b> in predictable fashion. More 
unpoiiani, foi the pui poses of this lepoiiat least, there seems to be lillle /* 
if an\ lelaliunship bel\\ecii the vaiious sections of the test (with the ^ 
possible exception of \ocabulai> questions based upoii passages of 
leading coinpiehension). 

The artick belo\\ proposes a \sa> of integrating in a test various 
Lnglisli languagt aits and skills in a meaningful way, in contexts which 
arc meaningful to teachers and students alike. 

It IS proposed thai an examination be built which will consist of 
twt) sections, each woi ih 50 ciediis. The first section w ill be constructed 
aiouiid a theme oi inteiesiand u le\ancc to students. The second section 
w ill iii\ oh K a piuL ess i equinng the students to use English skills in a life 
activity. 

For each section, it is assumed that it is based upon the course of 
suuly. 

I. Theme SLCiioVi y 

Let us considei the iheme section first. One has only to examine 
current anthologies, paperbacks, and other text and multi-media'multi- 
level materials to betome awase of themes which engage high school 
students. Typical themes are "Advcntuie," "Alienation." "Coping.** 
i nendship.** "Making Decisions," "Science in your Future." '*Who 
Am I?" and "\outh Fodav." Often the teaching of these themes in- 
\ohes the mtcgiation of experiences in reading, writing, speaking, and 
listening. Why should not the test on this theme leflect this integration? 

In planning this section of the test, the teachei may well do the 
following: 

1. Select a theme which is of interest to students. 
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2. Select coiueni from various media: books» perio(iicals, 
photographs, pictures^ recordings, charts, etc., use inuhi-level 
materials as well. 

3. Include questions testing skills in reading, writing, speakini,, 
and listening where possible. 

. 1. Review I 3 above to assure that each question, part of this section 
is logical for the context in which it appears. 

^ The example w hich appears below is for the theme "Youth Today." 

During theexamination, the follow ing would take place, question 
by question: 

1. \^rhe teacher announces that the theme of this section 
(RemerT\ber, there are two sections to the examination) is "Youth To- 
day^'* The teacher distributes answer sheets to the students. 

^ , , V 

2. Lhc teacher reads twice two articles to the students. One article is 
about a teen aged bo> named Dennis, an above-average high school 
senior who goes on to college. The second article is about a teen-aged 
girl, Cathy, a brilliant senior who graduates from high school and then 
goes to work as a mail person. 

On his answer sheet, the student answers 10 
multiple-choice cjuestions testing skills in listening (for 
main idea, for supporting details) to the two articles. 10 credits 

3. (a) The student reads a 150 word passage about a 
teen-ager. He or slje then answers 10 multiple-choice 
questions winch test comprehension, awareness of 



(b) The student then writes a 75-100 word 
paragraph in which he or she compares the person ir. (a) 
with a person in a current literary selection he or she has 
read, in one of the following lespects: appearance, 
enthusiasm, sense of purpose, self-knowledge, or other 
respect. The student must cite evidence from the passage 
(in (a)) and from the literary selection as well. 25 credits 

^1. The student is asked to indicate one specific 
reference tool which he would consult for mfoimaiion 
about "Youth Today" and to indicate the kindof informa- 
* tion he would find in that tool. 5 credits 



U. Process Section 

The Ji^to/irf section (50 credits) of the test would involve a process of 
significance to the students taking the .est. The word "process" here 
refers to those life activities which most students will engage in at one 
time or anothei. One of these activities is getting a job, for example. 



figurative language, etc. 



10 credits 



50 credits 
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riu' tCiiclu 1 wiMiUI lUiil li) pK'piiu this M c.tii-11 by ci^uipktiug the 
steps indicated below, and in this oider: 

1. Select the activity. 

2. I.ist all steps, in c hiunulogical uulei, invuhed in cainingoiit 
the activity. 

J. Foi each step, uUntif} specific I.nglish skills w Inch il nuoUes. 

4. Decide which of these specific skills can be tested. 

f). Define the objective of the skill to be tested. 

G. Dec ide upon the t\pe ufijuestion (i^^huit-ansuci, essay j or \ ehitle 
(tape, inteniew etc.) whivh will bpt test the .specific objective. 

7. Pr(;paie. and edit caiefully, the cjiibstions. 

A biief oiitlnie of an illustiati\( ai tt\ it> and tlu skdis nnohcd in it 
appeals below. 



Tsing a\ailal)le 
scnnces ol infonua- 
lion: a biocluiie on a 
specific jol)(s) 



Getting a Job 

Reading c ouipiehension 
and other basic leading 
skills 



IO<:iedits 



2. Reading an aclvei tise- 
nieni 



3. Writing a lettei of 
application { o r 
iesiuue) 



R ading; business 
awaieness; iindei standing 
of abbieviations and com- 
monly used terms 10 credits 

Writing: c^xpositoiy, per- 
suasive mateiial. Observing 
form, content, and 
language conventions. |f) credits 



!. Being in ten ie wed 



Listening: listening to a 
tape of an interview; ci iteria 
detei mined in advance. 
N.H. a speaking cjuestion, 
involving the iruciview 
situation, could be ad- 
niinisteied in advance of the 
test. 



15 ci edits 
50 credits 



i hv two s "ctions of the above test have se\eial advaiuages. 

I'Oi tcaihei ^f the test wcjidd leuifciue the uueiielalionship and 
integiatuiu of the Kuglish language aits .aid skilLs. IIk lest would 
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piobably have poicriii.illy guaia validii> and rcliabilii) ilun in- 
sirumaiis presciul) used, Furihennuie, the test iniglu prove more 
quickly responsi\e lo change dian other insiruinenis. 

For students, the lest would iinohe challenging expeiicnces bas- 
ed upon the students' vicaiious and leal intticsts. I'he students would 
be encouraged b> theattia(ti\en(;ssandiele\anceof thenew test, and 
would see that it is i elated to theii peiception of the world. Finally, the 
test would gi\e the students an additional leason fui iniegiating then 
skills in English with content, 

IV. Cautions 

Care ir i be taken that tlie theme scalon be based upon a con- 
cept or idea \ ich is bioad enough in scope, which will yield many in- 
terrelationships, and which will appeal to both boys and girls. ^Iso, 
each question should appeai leal and significant to the students. 

For the process section, the activity selected by the teacher must\be 
relevant to most if not all studcir Vath step must be defensible from 
the student's as well as the teac, point of view. The artificial or 
cpiurived must be shunned. { 

Foi both sections together, a sense of balance must pertain. The 
generalized, abstiact dienic of the theme section can be balanced by a 
practical pioblem in the process section. Also, the test as a whole must 
present an adequate sample of course content. 

The aiticle above icports some of the experimentation presently 
b- in'g conducted by the Bureau of English Education of the State 
Education Depaitment. 

Please notify the author of your reactions to this article.— ED. 

State Education Department 
Albany 
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The Cooperative 

Development of Growth 
Measures for the Ability 
to Read Fiction 



In view of today's increasing emphasis on educational account- 
ability, English teachers should re-examine some of their techniques 
for measuring giuutli in English skills. Although there arc many areas 
of English iiistiiiction that arc not amendable to multiple choice testsas 
growth measures, in some areas they may be quite useful. However, 
professionally prepared tests are generally not valid in measuring 
giowth in certain specific skills in an individual English curriculum; 
and individual, tcachei-inade tests often lack the sophistication needed 
to make them highly reliable and valid. Yet, if teachers work togedier on 
the construction of multiple choice tests to measure growth based on 
very specific objectives, a reasonable amount of validity and reliability 
can be attained w lUiout an inordinate amount of indiv idual effort. WiUi 
certain specific course objectiv es as illustrations, I w ill suggest a method 
of cooperatively developing valid and reliable multiple choice tests. 



The tests employ a commonly used format and consist of a series of 
readings from lyiic poems and narrative fiction with multiple choice 
questions after each sample. The basic purpose of these tests is to 
measure to what extent both the class and the individual student have 
progressed in specific skills during the course of a school year. Thus, 
content validity demands that the tect items examine the specific skills 
mentioned in the course objectives for that year. Grades should not be 
given on the basis of these tests alone, for they obviously measure only a 
part of tiieenure course. Nor are these tests necessarily valid indicators of 
future performance. Their major purpose is to measure growth, 
although they may also be used to diagnose areas of weakness as well. 

In a typical high school such tests could be given at the beginning 
and the end of each grade by the members of the English departnient. 
The prc-test and pust-test for each grade could be cooperatively 
developed by the English dcpar uncnt, lefined through item analysis and 
used for years with high reliability and validity .n examination of class 
mean stores vvill be a very strong indication of the amount of growth in 
specific skills, but individual assessments of growth have to be made 
more cautiously and in connection with other growth measures. 
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The redding selections li.usl not be familiar to the students nor 
should the student be requiied tohavt aknowledgeof pariiculat literary 
terms, texts, authois, or other tritieal information, for then the tests 
would U measuring so icthiri^ other than the skills specified. Teadiers 
should not attempt to teach foi Uitsi tests except to acquaint the students 
with the format. Indeed, teachers probably cannot teach to these tests. 
Moreover, if the English course is actually teaching whatsit claims it is 
teaching, the results \m\\ be apparent on the test results without any 
attempt to teach to the test. / 

Skills of Fictional Art 

Characterizatiori 

The first set of example objectives deals with skills of fictional art. 
Tlie fir St. objective i^ that the student will develop the ability to perceive 
atid interpret thai at/erizat ion in the short story. Each readmg selection 
briefly describes a/haracter. There are two questions after each selec- 
tion, one to see if the studi^nt perceives the character as he is presented 
and the other^ to see if the student can correctly infer or interpret 
something a b(f)ut the character. (The ideas for the tests of this series of ob- 
jectives are birsed on Charles R. Cooper's, Diagno5^jc Tests of Specific 
SkilL from^the evaluation sequence ol Responding. Ginn Interrelated 
Sequences in Literature, Ginn & Co.. Lexington, Mass., 1973.) The 
following is an example of such a reading selection and test questions. 

.\rnold drew his overalls a.id raveling gray sweater over his naked 
body. Irr the other narrow bed his brother Eugene went on sleeping, un- 
disturbed by the alarm clock's rusty ring. Arnold, watching his brother, 
felt a peculiar dismay, he was nine, six years younger than Eugene, and 
ill their waking hours it was he who was subordinate. . . 

from '*The Stone Boy" 
b) Gina Berriault 

1- Which of the following best describes Arnold? 

a) irritated, 

b) pessimistic, 

c) happy, 

* d) sligiitly jealous 

2. Which one of the following wouldArnoldbemostliktly todonext? 
a) Go downstairs and eat dinner, 
'b) Smother his brother with the pillow, 
c) Shoot his brother. 

• d) Ignore his brother completely. 

Tone and Point of View 

The second objective is that the student will develop the ability to 
perteit? and interpret tone and point of view m short stories and lyric 
poetry. The first question asLs the student to identify the tone or point of 
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view, i.e., the emotional effect of the reaciing sc*.«tion. The^second ques- 
tion askb the studi nt to CNplain hLs choice b> choosr a statement that 
best supports the aiis\\ei he selected in ihe fust ( stion. Such a test 
might look like this: 

Hand in clasped hand and side pres^ close to side, 
Siieiuly stand souie children of t[u X)r, 
And shyly, hrugiy eyes half-turr . aside. 
Observe the eatei througli the open dooi. 
Anonymous 

Translated from the Sanskrit 
by John Biough 

1. Which of the foUouing best descubes what ihi speaker is doing? 

a) Desciibing the nobility of man, 

b) criticizing people wlio do not provide for themselves, 

c) describing the beauty of childhood, 

* dj comparing one kind of man unfa\orabl> with others. 

2. Which OIK of the following staiemeius best supports > oui ansVvci to 
the first question? 

a) riiis is a commc;n theme in Sanskrit literature. 

* b) The toiumst bctueen the two t>pesof people speaks for 

itself. 

c) The poem has a lot of meaning 1n a few lines. 

d) The elaborate rhyme scheme conveys the tone. 

Imagery 

The third objective is that the .student will develop the ability to 
perceive and interpret imagery in the lyru poem. Again a reading selec- 
tion is followed b> tu o questiuns, the first requiring the student to iden- 
tify what is actually being conipaicd and the second lecjuiring the stu- 
dent to determine what the comparison implies or signifies. 

The moon was a ghostly galleon tossed upon cloudy seas. . . 

tiom "The Highwayman" 
y by Alfred Noyes 

\ 

1. In this poem die mooivis compared to: 

a) a bottle, 

* b) a ship. 

c) a ghost of a man, 

d) debris. 

2. What kind of night is it? 



a) snowy, 
* b) partly cloudy, 
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c) laiiiy, 
(I) moonless. 



Comprehension and Interpretation 

The seiond set of example ubjecti\ebdeaLsui th t lose leailing ski lli,. 
Mustuf the same eiiteiia appK to the te\sts of these skills as to the skills 
nieniioned pieviously. Each student will demonstrate growth in the 
ability to tornprehcnd and to interpret. The foimat of these tests diffeis 
fiom thoseaUni in that seveiaUiiiesiiuiiMlea ling with these skills could 
follou each icadin^i^ ^cleuion, uiiich woidd tend to be inoie lengthy. 
(Alan C. Purves. Literature Education in Ten Countries, John Wiley. 
New Yoik, 1973.) Compiehension iinuhes the main thoughts of die 
selections, atteniiun to detail, and an auareness of context. Interpreta- 
tion in\o!\es diauing infciences fium the subject mattei and the 
language of tlu sclcctioii/I'hereaic, of course, odiei close leading objec- 
tives but these will seive as illustrations: 

A cciiain Mrs. Pickney, sixty -six, died in London Christmas 
Day- 
It took the R.S.P.C.A. 
less tban a week 
to cany out her final will. Kill. 
How speedy probate comes in England. 

Two donkeys dead, three cats destroyed. 
Mr. Peter Hall-Patch, who fiied the shots, 
told the evening papers 

let's face it 
donkeys and horses 
don*t xoorry about tomorrow 
)ust about their next meal." 
Not a \cry lomaiuic cpiote 
bnt pocury is lost on animals 
though for an instant every dying thing 
understands the language of his bullet. 
May Mr. Hall-Patch find a death humane 
under horses* hoofs 
unloved in the lain. 

"Joy to the World" 
by Rod McKucn 

Many compiehension and interpretation questions could be 
ck\eloped using this poem. The first, second, and fifth test comprehen- 
sion and tlu thiid, fourth, .ind sixth questions test interpretation. I am 
suie that you tan come up uith better questions than these. 

1, Which i/f l! . follou ing stalement> is nut mentioned in the first six 
lines? 
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a) Mrs. Pickncy died on Christmas. 

b) ,Her wdl was quickly carried out by the R,S.F.C.A. 

• c) Mrs. Piekney died suddenly. 

d) Her will ordered that her animals be killed. 

2. Who was Mr. Peter Hall-Patch? 

♦ a) an employee of the R.S.P.C.A. 

b) a muideier 

c) a reporter \ 

d) a poet \ 

3. Wliat altitude does the speHk^express in the last three lines? 

a) joy, 

♦ b) anger, 

c) contentment, 

d) fear. 

4. rhe title of the poem is used primarily because 

a) the action takes place at Christmas 

* b) The use of the word joy is ironic and means the opposite 

of what it says. 
L) theuseof the word ]oy understates the feeling in the poem, 
d) the meter of the poem is like the song. 

5. What did Mr, Peter Hall-Patch mean in lines 10-13? 

a) He hates animals. 

b) Animals eat a lot, 

c) Animals sometimes die. 

♦ d) Animals have no feelings. 

6. The word humane in line 18 is used 

a) as an exaggeration, 

b) as an understatement, 

c) as an accurate statement, 

• d) with the opposite meaning. 

Developing the Tests 

Wliaiait the mechanics of cooperatively construcimg and evaluating 
such tests? An English department of ten teachers could develop a pre- 
test and post-test for the first set of example objectives, if each teacher 
selected six leadnigs and wrote two questions for each one. Each of the 
three sub-tests would then contain ten readings with twenty questions 
fui a total uf sixty readings and one hundred and twenty questions for 
both pre-test and [xjst-test. You could easily develop tests for all four 
glades for all of the objectives mentioned in this paper and any other 
aieas suited to these measures during a brief summer workshop Ob* 
\iously, a laigei faculty would make the task even less time-consuming 
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Item Analysis 



Once >ou h.ut tulla wd and culLual the R.uhiigs aiuk|ucstiuiis, 
>oii Jihoiikl aii.il>/<. tath test qucbliuii fui difficult} and disci iiiiinatiuii 
to Liuurc icj>i iL'liabiliiy. Often particular test itcin.s will be tuucas>, too 
difficult, or too ambiguous. 'nK,icf(jre, afttr >uu have gncn the test 
once*, picfcr.ibl> to a sample giuup, anal>/c the test items to make suic 
that lhc> arc in fact fail to the students. (A. C Crocker, Statistics for the 
Teacher or How to Put Figures in Their Plate, Penguin Books Ltd.. 
Harmondsuoith, 1969.) Item analysis is clerical work that should be 
done by computers, tcachci aids, or students. The first few times >ou use 
the test >ou will have to chan.5e some items, but eventually the test will 
become a highly reliable and valid measure of st)inc of your schoors ob- 
jectives for the English program. 



Item Discrimination 

Item discrimination analysis e\amincs hou well the test questions 
distiiininatc between the mou able and less able students. It compares 
the lop fourth or third of tin papeis with the bottom fourth or third for 
each ejuestion. If the (jucstion is doing its job, inoic of the top students 
will gel the question correct than those at the bottom. The formula is. 

M , \. w liere H ~ the number of times the high group answered the 
(-lueslion correctly, .md L " the luiinbu of times the low gioup .mswered 
the question correctly, and N - the nuinbei of students in one of the 
groups (e»ich subgroup should be the same si/e.J The lesults will f<dl 
sonu where between 1 through 0 to +1. A (]uestion which disci imiruites 
pcifcctly w ill get .i si ore of ^ 1 , .i 0 iiulie.ites no disci imin.ition atall,<ind 
a 1 indicates diat the (lutstion favois the low group. Items which fall 
below+0.3 should not be used again. 

Item Difficulty 

Although tests often begin with easy questions to give the student 
confidciK c, most tests later iiu ludi a few questitjiis which vvdl challenge 
t\cn the most able studints. Youi own experience as a teacher is very 
usehil in dctuliiig the difficulty K\elof the questions, but a calculation 
of item difficulty can ct^iifiinioi lontiadiei ytjui choice of question. The 
ftjimula is. " x 100% where Right is the number in the entire class 
who got the question light and N is the number of students in the entire 
class, riie niaje)rity of questions should have a diffu ulty index of Wo to 
00%; the higher the perceiKage, the easier the (luesiion. 



Conclusion 

The procedures outlined above may seem very time-consuming, as 
indeed (luy aie if <utuiiptul .doiu. Vet, when many aie responsible foi 
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MiuH pans of iliL Ilm. *i Infill) icliabk ami \*ilid icM can bccuiibtiuital 
wahoulaii inuidinalt »imuuia uftffoii. Moiccnti, llu iCMiltbiiiuii than 
jui)lif\ aii\ bniall tffoil. foi the cniiic Englij>h tkpailintiU now can 
iiuasuic with i;icalci acanat> gitnsih m .sumt \ ci\ iinpui tain bkilb in 
Its Luglish cumculuiii. \ou will Ik able tugivt an account of ^uuihcif 
with confidence. 

East Aurora High School 
East Aurora, New York 
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Are Six Weeks 

Gone Already? 
Or \ 

An Alternative To 
Measuring Growth 
In Writing Ability 

Kenneth Watson \ 

Introduction \ 

Many tcadiois of Knglish arc faced c\ci> six or bc\\n weeks witfi 
dcnriiids to evaluate and assign giadcs to students. I he d^jiiands coine 
not oidy fioin principals and guichuue counsel()ii> who \\\uu to keep 
scfiool lecoids cuirent, but fioni paicnts whoaieinteicsted in^theu son's 
or daughtci's pu)giess in school. In fact, ii wa.s at the insistence of 
paienis in Buffalo that in nian> subject aieas the lepoit caul uiaiking 
pciipd was shoitened fioni ten weeks to six or se\cn weeks to provide 
nioie hequeiu leports. 

Certain aspects of the English curriculum are more readily adapt- 
able to the short marking periods. Vocabulary study can be done on a 
weekly oi l)i-weekl> basis, foi example. A p!a> can be read in tw o, tliree 
or four weeks. However, how does one deteiinine giowtli in wiitmg 
ability in such a shoi t pei iod of time as six oi seven weeks? Doc\s a grade 
of sevemy-five on one maiking peiiod leallv indicate an> nieasiMable 
iinproveineiu o\ei a giade of seventy on a pic\ious inaiking pmod? * 

Fuiilieimoie, if an Knglish tcacliei must include diama tests, book 
ieix)its. and \arious cjui/, giades along w ith wiitiug giadcs all on one 
composite giade for the maiking peiiod, how doe:, the parent, the ad- 
ministrator, the guidance counselor oi even the student know in what 
areas he has improved and in what aieas he has done woise? Peihapsa 
better solution is needed. I'he solution .should liave two puiposes; (1) 
sepaiate the measuienient of giowtli in the ability to write from 
measurement of growth in othei arccUs and (2) space out the ineasuie- 
ment over a longei pei iod, allow ing foi ample, measui able giowtli to oc- 
cur during the intei\al. Suth a system would permit the student and 
parent to see the student's giowth in wiitiii*^ ability alone. Secondly, it 
permits theadministiation tomeasiiie thegiuw th in wi iting ability over 
a lopg period of time. The student's grow th could be seen and measured 
during his entire four years of high .school. 
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One such scluuK- that fulfills ihv above purposes \vas developecl by 
Dr. Paul B. Dicdn ic li. It first appeaieil in The Enghsh Journal (vol. 55, 
April I9bb) in an aiiiclcciuuled "How to Measure Growth m Writing 
Ability." In the follow iiig pages I w ill fust desci ibc Diedei ichN scluMiie 
and then lollow that h> adisuission indiiating wh> I think Diederich's 
scheme fulfills the puiposes I have set foith foi ineasuienient of giowth 
in the ability to wiite. 

Testing Conditions 

Writing foi a seluM>l test inav be defined as a total process involving 
how a peison feels. leacts. thinks and believes. To sample such a bioad 
range of affectn e behavn>rs. a teacher needs a lengthy piece of writing, 
Iheiefoie, it is un|>oita!it that the student be given an entire pci iod (for- 
tv to loi tv-five mmutes) ui ordei to plan and write his essay. I'opics for 
tlie es5>a> te.st aie chosen b\ all teacheis in the English department prior 
to the dav of the test. A final hstt>f topics is made up b> the department 
I haiimau. The final list of topics is not seen b> either the students or {\\^ 
leacheis until the day of the exam. 

Ihete.stisgiven onthesameda> toall studentsduiing their English 
classes. Once students have come into the room and taken their seats, 
they are given two sheets of papei. One sheet (or booklet) will'be used to 
write the response to the essay topic. The other sheet, which may be only 
a half or quarter sheet of papei, will be used to assure anonymity. 
Anonymity is impor tant in the scoring of the papers. On this sinal I sheet 
of ixiper the student writes the follow ing information: his name, grade 
level, the teacher's name, the period the class meets and a six-digit 
number he selects. This six-digit number is one that he chooses wnhout 
telling his teacher. It is written on both thesmall sheet as well as on the 
large sheelAv Inch contains his essa> response. It is theonly identification 
on the large sheet. After the test has been scored, the large and small 
sheets will be matched up b> number so that the student's response may 
then be, identified. An example of the smallidentification sheet foi lows- 

STUDENT IDENTIFICATION SHEfeT 

Six-Digit Number 

i\-nnc Teacher's Name , 

Grade Level Glass (Period) Date 
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I he student identification sheets are collected and kept hidden un- 
til the tests aie scoied. After the test, the test paper* arecoHected. All stu- 
dent papers ai e col lected in one location, such as the Engl ish department 
office. Mere all the papers are randomly sorted to assure that no teacher 
knows which papers he is receiving. Tlie most thorough and most fair 
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\vay lo^aiidunil) soil is to soil the papcis inimcricall> by the six-digil 
iiuniber at the top of each. Thus a 000-031 chustii b> a siudciU in one 
class niighr go iu\i to a 000-0 !6 clu}hcn b) a stiulciit in sonu othei class. 
This assures that no teachei knousuhich student papers he u ill giade. 
(At the same lime, someone else uould suit all the student identifieation 
slips by number so that tlivy can bt easily matchtd up uiih the papeis 
later.) 

Rating 

There are two readings of each student paper. Eaeh rcadei takes a 
ixjriion of the papers (one fifth foi/example, if diere are f!\e teachers) 
and sits doun with a grading slip for eaeh papei. The grading slip, 
which is the same foi all giadeis, lists eight ciiteiia. An example of the 
grading slip follows: 

READER'S ANALYTIC SCALE 

Topic Number 'Reader Number 

Paper fi-digit No. 





Low 




Middle 






Ideas 


2 


^1 


6 


8 


10 


Organization 


2 


•1 


6 


8 


10 


Wording 


I 


2 


3 


'4 


5 


Flavor 


1 


2 


3 


4 


5 



Usage 12 3 4 5 

Punctuation 12 3 4 5 

Spelling 12 3 4 5 

Handwriting 12 3 4 5 



Sum 



There are several reasons why this particular scale is chosen over 
other types. First, it isananaly tic scale. This divides the different aspects 
of the writing process into individual components. Thus, the reader is 
not forced to choose betvveen a high grade and a low grade for a paper 
with good ideas and oigani/ation, but with sloppy handwiiting or a 
plethora of spelling errors. Secondly, ceitainaspectsofv\riting towhich 
teachers may leact strongly are singled out, so tliat a reader may assign a 
poor rating on those one oi two aspects, and Uicn assign a bettei rating 
on some odier aspect. Foi example, if you have had an intensive si^lling 
unit for die past few weeks in youi classes and feel your students should 
know how to spell, then if you come across a student's paper diat is filled 
with spelling errors you feel are caieless and stupid, you may react un- 
favoiably to the ciitiic papei. Regardless of whether the papei belongs to 
one of your students oi not. you have already judged that paper to be a 
failure. By separating spelling (as only one of eight aspects on the 
analytic scalej, you are able to assign a poor rating on that aspect, but 
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then )ou laii KKiiil th( pwpci to ai>i>igti f<ittct, Ami piub«ibl> higher, 
latiiigs the otha aspects of tht stiulciit's uiitiiig. l luis the *iiial>tie 
..seale mi vis to alh.\ i«ite i>oiiieuh<it the tuitiiuil bi<ises th<it thc> do nut 
icMih in an unfan lating of the entiie p«ipet, whieh is bunietinus made 
up of a niixtuie of good and had points. 

I lie Rcadei 's Antdytie Scak wdl lesujt in a lating of ten (all low 's) 
to fift> («ill high's;. Siiue^ laili papei is lead b> two leadcis, the total 
possible lange will be twue that— fiuni twenty (all low's) to one bun- 
dled (all high's;. It IS inipottant, howe\ei, that the seeond reader docs 
not see the results of tin rating made b> the first reader. When the first 
readei is iloru giading his si t of papers, he should keep all of the r*iting 
slip,s in ruimeriuil uidu m a safi plaee, urUil the seeond r<iting is done. 
Also, no marks, torru:tions or lonmierUs should be pLieed on the paper, 
«ind. naturalK, the two readers should not discuss the papers. 

After the readers ha\e exchanged papers, and after each reader has 
read and filial out giading slips on two sets of papers, then all theiating 
slips are gathered and the studeru ideruifieation slips brought out of 
hiding. If all of thi slips have been kept in numerical ordjr, it will be no 
problem to match tlieni up b> humber with the ess»i> paper. Mach stu- 
dent issay usponsi willhavi oru studerU identification slip (ideruif> ing 
the author; and two rating slips (oru each from the two readers). These 
tline shps of paper should Ik stapled to the studeru's ess»i> sheet. One 
pioblcm might ar ise — namely , if two leaders' scores on a sUident paper 
\ar> widch. If the suncsdiffer b> over ten poirus(cle\en or more), thena 
tlitrd rcadci, stub as the dcpartrncnldiau man, should read theessa> and 
(.illrcr raise or lower one of the scores so that the resulting discrepancy is 
less than ten points. 

Itma> be useful, beforehand, for tuichers to obtain some practice on 
the arial>tu si ale uiordci to improve the reliability of their scores. Using 
sonu papers not related to tlu test, teachers could meet as a grotrp at a 
department meeting, indiv idtially late copies of the sanie paper, and 
then discuss their ratings. This practice \v ill enable teachers to learn how 
to rate, toiorifurm tluii rating so that vast discrepancies do not occur, 
and enable readers to do the acttral rating more (jtiickly. 

\ Using The Results 

Now, wUm do voii do with all of this? I would stiggest an idea 
borrovMcl from tlu art dcpai tmciit. As many of yoti know , colleges look- 
ing foi prospu tivi fn shnu n ar t majors tisk high school seniors to stib- 
mit a \)u\ tfolro of ihi rr Ix st ar t k. Whv coukhrt such «i por tfolio be 
kept for till stniliru's v\riting that hi has iloni throtighout four years of 
high school; Isn't \\\ ittiri i xprission as importtirU as ar tistic expression 
of brush, ciavori oi sti rii il? If v\e,as teachers of English, really do believe 
that Lriglisli isissintial in modern soiicty ami deserves the foirr ye*irsof 
stuily lequirid m most high schools, then why aren't we requiring (or 
iveu suggisting to our students; that then cirrreru work done.in high 
sihiMil nught be <i v<ilu<ible record tluit might he useful later on? 
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Ill some bcluxjis A -siuiknl fokki is kept in the English classiuoiii. 
Tlic fokk'i is nuiiiulh kept just fur um \cai, hu\vc\ci, and ilicn the 
papcis insiik- au liiiiial u\ci to the sliukiit in June and nc\ci sa?ii ur 
used again. It iniglil Ix bclki fui the sludeni to sec his papcis fiuin one 
>eai lu iht next. I le can then see his o\\ ii gi uu ih. fhe essa>s can funn a 
-basis fui the siudeni lu nicasuie his own giuwih, ihuugh the essa>s 
skuuki nut be the unl\ papeis iiichukd. Pei haps, sludenl wi iilen short 
stories, pla>s. iese»»ch papeis, luuspapei wiitiiig.and buuk lepui ts can 
go in. .VIso, at the end uf each >eai, the student cuuki write out his own 
e\ a 1 nation (nut a giack') of work he has aceoinpHshed dining the >ear, 
incliuling hteiatuie i i|ad in cKiss, hooks lead on his owii outside of ckiss, 
coniposititiiis uiitten <kuing the >CiU, and othei inateiial the teaeher oi 
^tuck'iu wishes .to inckide. 

hi ilic piecedijig paiagraph I ha\e tiied to stress the inipoitance of 
student uiiting. iiu kuling the essa>s, because I feel as a teachci of 
Knglisli that it is iiiipoi tant to ha\ c a conipkte. continuing lecord of stu- 
dent giowth. This is the onl> \\,\) that leal inedsureinent of grow ill is 
|X)ssiblc. • 

Vu come baek to t.ic latiiig scheme, the indi\idual student essay 
then is placed in a foldei. To this isadded tliiee otiiei essays wiitten latei 
ill th(' \eai. so that the stuileiit has foiii essays, written approximately 
e\ery two iiioiuhs (Xo\einl)ei. 'anuary, March tuid May), "flie four 
papeis, each lia\ iiig been icad by, two people, form a composite of eight 
different scoiesoii the student's wi iling. Since each score \anes horn ten 
to fifty points, the total foi the yeai willvaiy fiom eighty to foui hundred 
iKiiiiis. Research in w ritttii composition demonstrate^ that it takes at 
least foiii papeis and eight leaikrs to satisfy reliability i^iiteiia for the 
type ofjj)iiipaiison which I am going to suggest next. 



Student writing placed in .i folder is\ery necessary foi thestiukMit to 
see Iiis own giowtli, hut parents, guidance counselors and ad- 
niinistiatois aie also iiiteiested in seeing how the student's pei founaiice 
com paics with the pel foimanec of other students in liisgiaue.uid in the 
sdiool at laige. Foi example, .is a basis for admission to college many 
colleges: now le^qucst iiifoiination on a student's rank in class. 
Oiedeiich's plan yields this type of iiifoiination as a measure of growth 
in writing. 

Since all the seou^ will fall between eighty (minimum) and foui 
hundred points (iiiaxiimim). a teacliei can aiiaiige all of the giadcs 
mnneiic.illy frtjin highest to lowe.st. Peihaps this cm best be done by 
initially dividing tin papcis into seveial smallei. moie manageable 
groups, iKihaps with ili\ isitiiisof I3()aiid below, 131-200, 201-250,251- 
300, 30l-r)0, and 331-100. Then the papeis can be further subdivided, 
imtil they are all laiiked fioin the lowest (80) to the highest ( 100). Since 
this distribution will iiu lude all the seoies by all the Lnglishstudentsin 
the entire school, a student knows his standing in relation to the whole 
school. Prc'suinabl), many freshmen will be fouiidclosei to the bottom, 
and more seniors will be found neaier the top. This is as it should be. If it 
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wcie uihnwiM, iIkii hni^hsh luiclicis .should look fur^diffcrcnt jobs. If 
one ucif inlcicblcd in finding a bludciil's i.ink in cLibS, Tic h.is on.^ to 
anini how inan> paptisofsludcnls of his own grade kxci arc above hinu 
11 llie papns inow ^onipklcK scoud) ml ankd sonic wa\ to indicate 
giadc lc\cl this vould In icIatncK easy. Pcihaps a coloi for each grade 
lc\cl (bluc-ficihin.in, giccn ^soplioinore, red^junioi, black^scnior) 
inaikcd HI the uppci ught haiuKoincr would aid idcntifieation. This 
would make it cas> to lank a student in his class (for example, as I'.ie 
fillecnth highest heshiitanj .is well as in the school at large (foi example, 
as the one bundled tweiitiitlu. Thus the heshman student knows he did 
c\tieniel> well in coinp.ii ison w ith other freshmen, but JUjt as well as sa> 
the fifteenth laiiked stnioi v hupeihapsscoied thiit> seventh in relation 
I he • hole stutient botl> . I'lie student scoie and rank could be listedas 
f(>r 

p students ^ students 

Name Rank in in Rank in in 

class class school school 

Fushman ' 15 (300) 120 (1200) 

Scjphomoie 
^ Jiiiiioi 
Senior ^ 

Ihi., slip of papci should bt kept in the student's permanent English 
folder aiui each >e.ii his new lank in class and rank in school should be 
aildeU. Thus a norin.iine (ui comp.ua tivej ine.isuie of grow th in writing 
.jbility can be readily seen. 

I'lom this'pennanent record a te.iclier of English can sec that a 
student's growth in uiiting ability can show progress in two ways— 
both HI lank in cl.iss and also in lank in school. Of these two measures, 
pel haps the most iinpoit.int is giowth in rank in school. An> upward 
-movement in r.ink in school indicates real growth. In c^^mparison, 
giowth in i.ink in class inean^ that a student is learning faster dian his 
cl.issimtes, but giowth in lank in school indicates that the student is 
assnnilating skill duiing his four >ears in high school. A student may 
iitjl change lank m hisoun i l.iss(gi.ide level) \er> much at all during his 
font >e.us. He ma> have ranks like the following, fieshinan (96), 
sophomore (10,2), junior (98^, .ind senior (100). Does this mean tjiesiu- 
* dent has not giown dui !ng his fou^>e.ns? No. That same student ina> 
have h.id the following i.inks in school, freshman (1050). sophomore 
(800). junioi (525), and senior (100). The increase from rank 1050 (ncui 
the bottom of the seliooi) to 200 (close to the top) indieates that the slu 
defit h.is giown in his abilit> to write duiing his foui >ears, a fad not 
evidenced by Lis rai^k in class alone. 

. , Responses ro*Critic*^m 

(-eit.nn \aiiables on mdividual pieees of writing still present their 
piubleins m this t>pe of test situation .is in the normal cl.issrooin tests. 
I'or example, a student may feel upset, fatigued or for some other 
pliysi^)h»gKal oi ps>( hological re.ison ma> not be able to do his best on 
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the IcM. Also, even w ilh two UtU kij^tii^et^i Icsl. both ictukr.s nu> grade 

their sets of papers harshly » resulting iii signiritfiniK lower graiks lor 
the .ets of papers. (A movement t;Hhe left of on(eoliuimun the Reader s 
Analy tieal Scale sheet results in ten fewer points Out of fift> possible on 
the store.) riuis rnstead nfreiervmg 8-8- i-i- i-l-i- 1- {U)ii\ total), a stu- 
dent might receive 6"6-3-^-3-3-3 (thirty total). Even teachers have 
their bad days. However, rn light of these variables affeiting students 
and teachers, isn't rt better to ha\e four papers horn each student per 
year, and eight grailers, rather than one firral exam grade graded by one 
teacher.^ Even if exams are retained, the essays, along with the ranks in 
elass and ranks in sehool form anexeellent second look at the student's 
groU'th in writing ability. 

Perhaps the principal criticism against undertaking this projec t is 
the amount of time rnvolved. How long does it really take? Bear rn mmd 
that you make no red peiKil marks on the essay. Furthermore, first rm 
pressions art valued. In keeping with this, the reader shoulcl sperrd no 
mote than two minutes per paper— time^*nough to read about three 
hundred words. In scoring two papers, he will have spent a total of only 
four minutes rating Ixjth. On the average a teacher may spend from five 
to eight minutes per pajjer, nhiikiiig mist.ikes in spellrng and m.ikrng 
corrirrients on ideas or organization. So this rating of two sets of p.ipers 
really takes less time than the normal time needed to grade a set of stu- 
dent comi>ositions. 

Furthermore, what do you have when you finish.^ Normally, <ifter 
making many red penciled marks you havO only one nnjrcset of com- 
positions to return to the students. You know how well johnny did in 
comparison with other students in your room, but you can only guess 
how well Johnny did in relation to^^^r students in his gr»ide. Is »i 
seventy -five in your class the same as a seventy -five from anodier te.icher? 
Diederieh's scheme yields each student a r.ink in his whole grade level 
and in his whole school, not merely in one teacher's classes. 

What I am tryrng to .show is that you as a teacher of English have 
;>umet}iing permanent and verifiable. You have something that has been 
c\aluatecl and scored by other faculty members of your dep.utrnerrt. No 
parent, administrator or student earr claim any unfair bias on your p»irt 
in the ^coring of the essays. Fur therrncjre, you have verrfiable proof of <i 
students growth in writing ability throughout four years of high 
school. At the end of four years a student will have written sixteen of 
these essays (lour each year) and have been assigned four ranks in class 
and four ranks in school at large. Tpwarcl growth in the latter rank is 
proof that the student has learned to write better. 

I feel tlu»i the alxne reasons strongly urge us as^teachers of Englrsh 
to use DiecU* h'ssclunu to measure growth in w riling <tbi I ity. Only rn 
this way can v\e prove to (jur criiics th.it we do have real, rrreasurable 
growth in writing ability occurring in our schools. 

Riverside High School 



Buffalo 




56 



55 



Grades and Growth in 
the Writing Program 

Chark's R Ooopci 
Introduction 

Aflii «i sUiiknt Udi> pruiliuidapiat uf wiitiiig, huu du \vc lu lp him 
an«>ut*KU»<^ "^<^ qut.sliun-'>. Wlui h.i\t I duiit? liuw goud is it? What shoiikl 
I ilii ni'XtTinitT In this.utuk I w.int tupiupusc p.ii ti.il answcis t(j those 
qiKsliuns. I ht answus w ill uivuKc us in what is incuasingK referred to 
ihtsi da\s as funnalivt evaluation, a pioiess of respijuse and feedback 
tliat nifonn.-* thi studuit uf huw wt II lu isdunij^and infuinis the teachei 
about tht tffei ineniss of UKstiiU.tion oi student practice. Since this new 
t( iin and otlu i •> u latui to H au often used in connection w ith school dis 
tiul uRa^incnuiit .iiul e\alnation seluniesand with teachci a(( *Mni- 
abdit>, I \vant to spend some time discussing these terms in this in- 
tioduc tioM to the main pai t of the ai title. In paiticular, I want to show 
how sonu of tlu new measincnient and e\aluati(jn concepts h.ive 
limited use for Knglish u*achei-s. 

1 Ir teim lurnialii'f t i aluatiun is most often used in the context of 
ttuustvry leariiui^, an uisnuctional scheme of some use in biulog> but 
piobablv of no use m wiunig. ConventionaM> ustxl, formative evalua- 
tion implies (oi lequucs) bhoit, secpienced units of instruction which 
c<m be luasteud,' the masteiv being demonstiated b> imit tests, usualiv 
I MicMon-iekicnud, that is, specif icalh written foi the stated objecti\es 
of the innt. For example, the student studies the concept of 
(jhoto^ynthesu foi two weeks and then t.ikesa mastci> test; if he scores 
abo\e 80"o, ht goes on to the ntAt unit ui stud\. Obviously, such an 
nisliui tional-ineasuitment appioach is not useful to writing teacheis. 
I here aie two m<un piejblems with it. (I) it assumes that points or 
plateaus of masti i > tan be uk ntifitd and (2; i 1 1 equires that the subject or 
skdl be brcjken dtnvn int(j sm.dl, se(|Ueniial, testable units. 

(«ni .1 lugli school junior "m.istei" the essay of aiguinent or the 
auiejbi(jgiaphital mejeknt, oi e\en tiie descriptive paiagniph or the 
busmtss k ttei? (-an a collcgt jumoi: Isn't writing a skill that one cm 
oiilv getbettei atbutntvti mastti.txeept in supcificialaspectsof sciibal 
.muiae\ (spelling) and foimat, I long .igo masteied the formal of the 
busmess kttei. but I nevei think of myself as .i masterhd writer of 
business ktteis, of h.iving le.iehed S(jme pl.ite.iu of efficiency and 
notable high eiuality. L.|ch new lettei i.a unique problem, requiring 
mipoitant juelgiiieiits of kJiie, (Jiganuation, diction, and syntax. Often 
my busmess k ttcis hteially fail, they iiiitate when I meant to soothe, oi 
lliey alaiiiiwheni meiely meant to ink)iin. I lurthmjioinoui ownex- 
peiiene-t as wiiteis we can e(jneluek that the (onventional concept of 
masleiy kaiiiing is not ust ful— i3 piobably e\en(|uitt misle.ieling— to 
us as writing teacheis. 
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riieoihci inajoi piobkm w ilh iiusu i> kaiiiiiigai> a way of tliiiik- 
iiig about u...hing wrilih^; aiul c\aliiatiiig grow ill tti >oiuig wiitcrs is 
thai it leads to fiagiiiciUiiigaiul fa 1st categories. What arc the units of the 
aeli\it\ of becoming a bettei wiitei oi of the aiti\it> of composing a 
single piece of writing? Pieces of uiiting are composed of woids, 
phiases. sentences, and sometimes of paiagiaphs, but those units do not 
pio\i(le a wa> of planning and se(|uencmg wiiting instruction. Com- 
posing is a holistic at ti\ it>. Once the writei has produced a piece, then 
ihcic is much we can say to him about its language, syntax, ihetoric, 
style, and effect, but wt cannot an tici|Tate what a particular writer needs 
to know or piaclict until we lune seen his wiiting. There is nothing 
about thewiiting piocess'>i about w i itten pieces that w ill permit us to 
plair^stiuction in shoit units foi all students to inastei, c\en at their 
own speed in a piogi.iinincd format, w ithmastciy demonstiated by tests. 
Writing has no con tent, in the way biology has content. Wiiting is a skill 
to be practiced. Theie aie no incremental, sequential beha\ ioral oi per- 
foimaiue specifications for such a skill. Flic writer writes and then sees 
what he has. He gets lesponse from others. Then he ie\ises or writes 
another pieu. Writing instiuction must enhance that process, not sul. 
vcri it with trivial and indefensible mastery units. 

There are certain syntactic patterns and wold usage features 
students can usefully piactice independent of the act of writing or revis- 
ing. Wt know from icsearch that a special kind of sentence-combining 
piacticc enhances written Syntactic fluency and that oral-aural dull on 
particular usage problems can be quite effective, but this arhetorical 
piactice cannot be viewed as preparation for w riting— it should not fill 
up the first few weeks of class time before the student writes his fiist 
piece -and it cannot be tightly sequenced in small, testable units on any 
grounds 1 know of. Equally important, it cannot be tested in conven- 
tional mastery unit fashion. A valid'test" of syntactic maturity andcon- 
iiol of the forms of standaid usage CtUi only come fiom examining the 
student's writing, at the end of the year is he making fewei usage 
dev lances per 100 words and ar^' his independent clauses longei on 
average, more deeply embedded, more varied in structure? 

In some schools the notion of mastery Ictirning and the idea of in- 
div iduali/ed instruttion have conjoined to create a inonstcr, sometimes 
named LAP (Learning Activ ity Packet) or PIK (Personalized Instruction 
Kit). Nearly all the w riting LAP's I've seen are horrors, directing thestu- 
dent to woik in isolation through some pages in a workbook or 
piogrammed textbook and then take a mastery test. Individualizing in- 
struction is a fashionable (but iinpoitantj development vv hich we don't 
need to be anxious about. Good writing instruction is always in- 
(lividuali/ctl, even when the teacher gives the writing assignment* The 
student writtsa piect which gets t|uitc pcisonali^ed attention from the 
teacher and from othei students. And then perhaps the student revises, 
and that piece gets anothei personal response, not the predictable 
programmed instrtiction cajolery of the cathode lay tulx; or the 
workbook frame oi the eini,*> satisfaction of scoring 86?o on an unhelp- 
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fill LAP niasici> icsl un naming bcnicncc parts, bul a sensitive human 
respijnse which can take an> uf the fuims I . my formative evaluation 
scheme outlined below. 

Let us adnnt, then, that vviiting is nut a skill that high school and 
college students "master" and that it is not a skill or activity that can be 
fiagmeiited into units fui sc^juential instruction. Let us use the notion uf 
formative evaluation to mean only response and feedback to the writer's 
efforts, feedback that describes for him what he has done, conveys un- 
misiakably how other readers (the teachei and other students) under- 
siand what he has said, and indicates unambiguously what he must do 
differently when he le vises ur writes the next piece. This feedback would 
be concerned mainly with ihetorical and stylistic matters, and only 
secondarily with matteis uf correctness, with spelling, usage, and punc 
tuation. 

This article proposes ways to pruv ide that feedback after a writer has 
piudueed a piece. In a sense it is an articleabout writing instruction, and 
yet I want to try tu keep the focus mure narrowly on formative feedback, 
omitting such imjjortant luatteis as guided prewriting activities and the 
leaching of stylistic refinements, intellectual strategies, and syntactic 
fluency, nut tu mentiun planning the writing program and sequencing 
wilting tasks. I will also nut deal directly with summative evaluation, 
lilt mcasureinent of gruw di in w riling ability over a period of time. For 
infurmatiun abuutgiuw th measurement see Kenneth Watson's article in 
Uiis issue and my article ui the March 1975 English Journal (Cooper, 



I am also nulcunceined herewith die question of assigning grades 
lu pieces uf student writing. Grading individual pieces subverts the for- 
mative evaluation process I want to describe below. We have to give up 
putting grades on student writing, dridirisiGAdcor\CQn{ra{Gor\ pro\iding 
111 the classroom the response a writer must have to ivhat he is produc- 
ing. Grades do not even euntribute to summative evaluation. A row of 
grades in the gradebook is not a measure of anything. The writing 
teacher's task is to foster growth and to describe what growth is oc- 
curring. Once we have described a writer's growUi over a period of time 
^several weeks ur months), then we can assign a public grade to it if we 
have to — and we still have to in most schools and colleges. 

The last argument of the defender of grading every piece is thatcap- 
live adolescents vmII nut continue writing unless each piece is graded. 
I he experience uf many teachers now easily refutes that argument. 
Students will cuntinue to produce large amounts of writing if the 
writing tasks are not uniformly dull and pedestrian and unrelated to 
their experience, if they can see some purpose for wriung beyond pleas 
mg the teacher, and if they can write forniany audiences, not just for the 
teacher. Students do need response to each piece, and that is what ibr 
procedures I .im going to outline below are designed to do. 
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Tin's is an article, then, on what tudu besides grade \v ritiug and give 
icsts un iufuiniatiun about writing and language. It is an article about 
formative evaluation English style. 
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Formative Evaluation for Guiding 
Growth in Writing 

Formative evaluation— ^o suiamari/r my use of the concept here — 
IS litlpful response to the writer's efforts. It tells him what he has done, 
liow effective he has been in communicating with his intended audience, 
and what he might do differently next time he writes in that mode for 
that audience. It goes on continuously with each piece the writer 
produces, shaping his scribal activ ity, moving him sluwly in the direc- 
tion of what mature writers do, but not measuring him against an adult 
criterion, not expecting "mastery, ' but only some demonstration of 
giowth from the point where he started in the course. It should point out 
mistakes, confusions, ambiguities, and failures, but it should be mainly 
on the positive side in or^der to encourage the writer to ay again and 
again. It should foster confidence and reward freshness, vigor, and 
lionesiy. Most important, it should help the young writer find his own 
voice. 

Tlie teacher guides this evaluation process, participating in it 
liunself, but also arranging for students to participate, training them to 
de- so effectiv ely . What exactly do the teacher and the students do? I want 
to propose four general activities. 

i. The teacher talks to the student or writes comments on his paper. 
Making comments or corrections on the student spa|>er without thestu 
dent actually present should be done only as a List resort or as an ex- 
pedient. A conference with the student about his paper is always 
preferable. F-ven with classes as large as they are, we must still do as 
much conferencing a^ we can possibly arrange, even if it meansdevoting 
several days a month to it, with activities for the rest of the class members 
carefully planned so the time is not lost for them. We must also patiently 
ui*» persistently continue making the case for smaller class sizes, even in 
iliese hard tiiYies. The new concern with "basic skills " may aid us here. 
Writing isa most crucial basic ^'^kill, andgood basic skill instruction can 
not be had on the cheap. 

Whether we talk tjr write comments, we should initially withhold 
judgment about the worth of the paper as well .is overlook usage, spell- 
ing, and transcription problems while we concentrate on (1) making a 
pcrstjiiai ies|x>nsc to what the student is try ing to say, to the composition 
beliiiid the transcription and (2) describing to the student what he has 
done. Some papers, written for the teacher as trusted adu,i, will require 
only the personal ies|>onse. Description, detailed commeM, and editing 
are best used selectively on papers that have real promise, papers tliai 
may be published in some form for the class— read aloud b> the student 
or llie teacher, put up on the bulletin board, pasted into the class writing 
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8ciaplx>uk, published in tlu class nuigaziiit, ui sent off clscwhm- tu be 
publishccK |X-'rhaps in the school luuspapei oi hictai) inaga/iiic. 

It is \ c'l > hc lphil if the student keeps all of his u ritiiie; in a folder or if 
in accumulates it alcjiig uith icv iskjiisiii a spiral notebook. At each con- 
ference he brint;s all of his uoik ui'Ii hiia, not just the last piece. If 
students are keeping a journal along with the rcgulai wilting we are 
assigning, wc can altcinatc confeiciucs on the journal and on assigned 
wTiiing. 

GcK)d confcunees aic intense, focused and fast-paced, the latter be- 
ing iin|XMtant just to get around to e\er>cjne, The conference should 
always begin with the personal lesponse of a sympathetic reader, the 
teacher, to a young wiitei. It can then moveon to a description—not an 
assessment or a judgment— of what the writer has clone. We can deal 
with matteis of organiMtion, syntax, and diction, all within the 
framework of the w liter's puipose, subject, and audience for that |)icce. 
\Vc probably should Ik seleeti\ e, not try ing to cure all ills at once. If the 
paper warrants it, wc can make suggestions for revision, or we can just 
ask the student to tiy another piece in thai mode. Gradually, the student 
can donioiea:id inoie of the talking in the eonfeienees. Wc can ask him 
what is the best thing in his paper, the weakest thing, what he would do 
wiUi the paper. We can enconiage him to explain and defend, to "s.iy 
what he meant," to begin to take responsibility for his writing, 

Hie Ihhi ariidvs I have seen iceently on lesponding to student 
wiiting are by James Klein, Lois McCallistcr, Donald Murray, and 
Stephen Judy. They are all listed in tlu bibliography to this article and I 
iccommeiul them c iithusiastically. Murray, a Pulit/er Prize winner and 
a wilting teacher, has this to say about the teacher as reader of student 
wilting. He doesn't hxjk for what he hojjcs w ill be there or ought to be 
llieic, instead he listens foi what is theie. He is ready for the unexpected, 
alert to a hint, a word, a tone, a fact, a shape, a subject which will m.ikc 
him us|x;nd as a leader, a human being, not an English teacher." judy's 
cxticmdy helpful and detailed aiticle outlines seven steps in the process 
of u s|X>iVling. listening foi the student's v oice and deciding whether the 
piece is leal oi fake, lesponding in .1 personal way in a conference or m 
written eominenls, deciding wlietliei the piece should be kept puvateoi 
made public ttj the elass,dcteiiiiiiiiiiga foiin of publication or distribu- 
tion in the (lass, editing, copy leading, and "publishing." Only a few 
pieces would make it all the way through this process. 

A \cry promising possibility for lesponse to student wiiting is out- 
lined in an iinpoitaiit recent ai title by my colleague Lee Odell (Odcll, 
1973), who is studying the intellectual strategics (for example, focus, 
ctjiitrast, tliaii^^e, reference to seejuenee, refeiencc to physical context, 
classification) apparent in students* wiiting. Odell argues that "if we are 
to make genuinely useful responses to students* writing, we need to 
devote a gocnl deal of oui cffoit to identifying mental processes implicit 
in theil language and helping students add tejand refine strategies they 
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aliiad) pussies. . . laii lulp ilum iiuiMci some uf tin pruccssis that 
*m puicciiUbilis lodfciUM wnimg, . . , Wluii wv icspuiid tu studcius' 
wiiiiiig 1)> lulpiiig iliciii culaigi ami uiipiuM upon llicir icpcituircof 
iiiulluiual sliaiii»us, ilu UMfuliicbs of oui ribpuiuc extends well 
lK>otul A spiufu assignimni foi a siiigk loiirsc." Hicrc is sonic 
i\ukiRc sinduu^s tan bi taught to iniicasi thi use of appropiiatc ui- 
tclU'Ctual strategics in their wilting (Odcll, 1974). 

2. The icaOier kads whole t lax\ diM n^^ton of representative pieces 
of student u Tititii;, Siiiti v\t louKlaigiK that there is no siieh thing as a 
"upuseiitative" pieu of student wilting ui that writers are really in- 
itio sted uiil> In talk about tluii uwn pieces and not those of someone 
iIh. wi should usi thisaithitv eautiuusly and spai iiigly. It should never 
betoiiu a substltuti foi tlu tuit lui student eonference. Caiefully plan- 
ned, how e\ei . it laii Ix cjuUe effeeti\ e. We ditto a pieet of student w i ituig 
or we make an o\ erhead piojeetor traiispareiie> of a pieee. Seleeting a 
few things of interest in the pieee, ue lead a elass diseussion about it. 
t\entuall>. the studdits eaii do most of the talking. We have all done 
this soit of thing, but, let me illustrate how it might look in the 
( liissiooni. Here is a pie(e of writing by a twelfth grader: 

My Best Class 

' Flu best class I was in wasni> ele\eiith giade history elass, found 
this c lass vay Interesting because the tuielier looked upon eaeli student 
as a >ouiig lad> or young gentlemen and not as little t^hi'dren. 'We 
studied out of a textbook. l)ut tlu class was still Interesting because she 
would leLite wliatevei topic we weie on to the current news. *Sliewas 
always pleasant and \v ilhiig to sliaie some news article with the ehiss. 
\S1k wouldcluKJsc atopic wlilelialic knew would liiteicst the class. H he 
I lass was alwa>s in oidcr. ^Vsfar .is I can remember there was never »i dis- 
turbaiue in tlu dass. '^Slie would eiicoui.ige you to do your homework, 
but if >ou didn't do it she would tell you/'Vou are only hurting yourself 
and iiooiu elsi." **SKt would iie\cr force you to do any thing you dldirt 
want 10 do, *"Slie was a vciy good teacher. 

Now let's assiinu we have chosen diis "representative" piece from 
iIk elass iiioiilci to point out some posslbilitii:* foi iiii^ieasing syntactic 
flueiu> and vantty, being caicful to emphasize the point that syntactic 
choices ha\e to be mack within the context of the whole ihetorieal 
simatioii— someone sa>ing something for a reason lo a particular 
audience. 

Although the iiieaii length of the independent clauses is only 12.6 
words for the thirteen independent clauses In the ten sentences in the 
piece (about that of the aveiage eighth giaelei) the piece liasa reasonable 
degree of s>!i tactic fluency. Sentences 2, 3, 7, and 8 have adverb clause^. 
Sentences 5 and 9 have aeljee ti\e clauses. Scntciue 3 has a noun clause. 
And >et vve notice right av\ ay the sentences ate not very complex struc- 
turally, not verv deeply embedded (except f^ Sentence 3 with the 
"wluitcvei" noun clause inside the "because ' ad\eib clause), and lack- 
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uig absolute phrases, sliong medial iiiixlificaliuii, or iiguii subsliluics in 
llic subject |X)sition. 

Wliat could uc say to the class about this piece? We might suggest 
llie following possibilities: 

1. Begin Sentence 2 with the "because" clause. 

2. -Jiegin Sentence 3 with "Even though." 

3. Embed the first part of Sentence 1, "She was always pleasant,*' in 
Sentence 2 as follows. . .the teacher was always pleasant and 
always looked upon each student. . ." 

f. Then begin Sentence f w ith "Always willing" and attach it to 
Sentence 5 following. 

3. Attach Sentence 7 to Sentence 6 by creating an absolute begin- 
ning "there ne\cr being." (Here the use of the term "absolute" 
would not be important. Students will see die usefulness of the 
new structure without ever having heard about "absolute 
phrases ") 

6. Attach Sentence 9 to the first clause in Sentence 8 by creating 
another absolute beginning "never forcing." 

7. I hen make a new sentence of the second clause in Sentence 8 by 
beginning "If you didn't want to do your homework. . 

Now with this sliort piece I don't want 10 make any grand claims for 
tile overall effects of these changes. But I have demonstrated how 
elements can be moved around in a piece of writing to achieve greater 
structural variety. I did create a participle phrase sentence opener 
^ 'Always willing../') and two absolute phrases, and I increased the 
mean length of the independent clauses to 20.5 woids, well beyond that 
of the average twelfth grader. 

These teacher-led discussions can focus anywhere in the piece. They 
c<ui either be planned to show the students something in particular oi to 
diau them out about the piece, geuing diem to suggest changes. A great 
advantcige of these discussions is that diey areamoilel for die students of 
wliat can besaidabouta piece of writing, an insightthey need todevelop 
to work helpfully in the two remaining activities I want to discuss. 

3. In pairs studenLs give each other guided feedback about their 
writing. TlicactiMties I want to recommend could also be used in small 
groui>s of five or six, but I have found they work best with pairs. If one 
student wiites comments and makes marks on a paper, the second stu- 
dent to look at the same paper is going to be unavoidably influenced by 
tliose marks and comments. Furthermore, one set of marks and com- 
iiieiits may Ix enough for one writer to heed, particularly if the teacher 
gives feedback on the piece as well. Having several students read and res- 
IxMid to a piece is also veiy time consuming. When two students cx- 
eliange papers, they can get fairly far into comments and discussion on 
bodi papers within fifteen or twenty minutes. 
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I luuc fouiul lh.il.il fiiM lliot siiukni paiis, v\a\ colkgc stiulcnth 
.irul gr.idiMlcs, nml spccifk dutcuuns. riu> nml tu bi tukl wlut to 
look Tut .uidwh.iiiu du. rh<.> will iimUuiisidti.djk help in ordci lugcl 
Ik>oik1 bl.iiid judgim^i.il ic.iclioiis. In f.it l. the must useful .Rtivities I 
h.i\t seen prec/u(/t' judgiiiciils. E\cniu.dl>, U4 luuim , \vc w.iiit sludciils 
to relish these le.id .iiid rcspoiid sessions, to be confident in theii 
ics|x)nses, .iiid to know hou to gi\t helpful, focused feedb.iek. 

riie best .ietivit> I h.ivc seen— students fioiii Gr.ide 7 to gradu.ite 
school like it .liul cdii do it e.isil> — comes from Peter Kl bow's book 
Writing Without Teachers (Elbow, 1973). It h.is three stages, pointing, 
sunmiarizingy and showing. I will explain the first two here and t;n- 
courage you to read Elbow for the third. 

Pointing in\ol\es (I ) putting .1 sti. light line under words or phr.ises 
that >ou like and (2) putting a w.i\> line under those >ou don't like. 
Ell^ow desciibes the first in thiswa>. "the words and phrases which most 
Micccssfully peiieu.ited >oui skull, perhaps the> seemed loud or full of 
voice, or they seemed to li.i\e a lot of energy, 01 they somehow rang true, 
01 iliey c.irried special com ict ion/' And the second this way. words .ind 
phr.ises tliat strike you .is particularly weak or cm^^ty. Somehow they 
ring false, hollow, pl.istic. They bounced ineffectually off your skull." 
Tlic student points on his second re.iding of the piece, and the decisions 
arceiuirely his own. In discu%sioii iinrnedi.itely following, each student 
reader c.in explain .is well .is he can to e.ich student writer why he 
pointed as lie did. 

Siinimarizing involves these four steps (quoted directly from 
Elbow): 

L First tell very quickly what you found to be the main points, 
main feelings. 01 centersof gravity. Justsoriof say whatcomes to 
mind for fifteen seconds, for example, ''Let's see, very sad, the 
death seemed to be {he main event; um. . .but the joke she told 
was very prominent; lots of clodies." 

2. Then summarize i: into a single sentence. 

3. riien choose one word from the writing whi^^h best suminarizes 
it. 

k Then choose a word that isn't in the vv riling to summarize it. 

M.ike copies of these steps for the students, .ind encourage them to 
follow the steps ex.ictly .it first. Summarizing is to be done informally 
without too much pl.inniiig 01 thinking. It shows the writer how his 
piece struck one other re.ider. As with poinLing, discussion can follow 
immediately Ixitween the two students. 

Another source of ide.is for directed feedback is Ken M.icrorie's Tell- 
ing Writing (Macrorie, 1970). Scattered throughout the book are ide.is 
like this one. to identify repetition draw a circle .iround all the repealed 
words (Ix'sides a, and, the, of, etc.) so the w riter c.in consider whether he 
needs to keep all of them, and draw a circle around words and phr.ises 
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>ou lliiiik icpcal tti('anitig.s iunucchbaiil>. I highl} uxumnR'ntl 
Macioric'b Cliaplci 9, Ciilici/.ing, foi a gcncial dihcussiuu of whal it 
means to give and leceivc criticism qf waiting. 

Pandean lulp laili ullici u itli an> aspcclof ilicu iilingilic> arc do- 
ing. Sunictnncs htiuknts uf snnilai ability can be paiicd, and at otiici 
inncb weak students can be paired with i>tiong students. The rcadci 
wiilci paiiiiig.s can liavt ijuite diffcunt pin poses, from quick, pcisoiial 
lesponses to fiist diafts to editing and cop> leading just prioi to 
publisliiiig in tilt Ias5 niaga/.nicoi sending off to the school new spapci . 

I. /;/ small groupie of five or six students form a permanent writing 
workshop to give each other feedback. 

Man> writeis have shown liow to use the writing workshop in 
English classes at both the school and college level (Elbow, 1973; 
Mac rone, 1970, Muffett, 1968;. Some build the entiie in -class wiitiiig 
piogiani aiouiid it. while others use it only occasionally for particulai 
pui posts. Withyouiigci school-age kids it takes patience and persistence 
to get It staited, but the effort does seem justified to me, paiticulai ly »is 
class sizes giuw laigei. Since we can't get around to stutients often 
enough foi w i iting tniifeiences, I don't see any uthei way to piovide the 
amount of foiinativc i espouse and feedback v\iiteis must have unless wc 
pel feet the wilting woikshup ^andi>tiKlcnt pairs) as well as weaic.ibic in 
oui classes. Two things aie crucial. {1} training students to work effec- 
tively in small gioups and [2) slit)\ving stutients what to look ftii in 
aiiothci's wilting and how to rcspund helpfully. Two excellent souices 
t)f gioup liaining activities are Sax and Hollaiuler's Reality Games 
i 1972; and Staiifoid and Stanfours Learning Discussion Skills through 
(tames. The itieas from Elbow and Macrorie above begin to illustiate 
w'lial is involved in showing students what to look for. 

Aftei we have some act|uaintance with the students and with their 
writing, we can foim permanent workshop groups of fi.vc or six 
students. Each group can have the full range of writing abilities in the 
class. We tan set out to get them acquainted and to Uain them to work 
tt>gethei effectively. As often as we can, wcsif in with each grtnip and 
join tilt reading anddiscussmg. In doingso weinoiiel for them vv hat can 
In said abinit a piece of writing and what it means to be a good listenci 
and a focused, helpful respondci. We also provide this inotlelling when 
we lead whole-class discussion of student writing. 

At fust ^students tan just pass around the circle tlie pieces they have 
wiitteii, t)r they can read aloud to eacl. other what they have written. 
1 hey can soon be given specific tasks, things to look for, proofreading, 
editing, pointitig, summarizmg/l'lui) can bring tothegiouponly what 
they are wMlling to make public. 

vSoine teacheis find that the friendship oi same sex group ^ works 
better than tht teacher arrangcti group, especially in Grades 7, ami 8, 
where students are still aversive to the opposite sex, or at least acutely 
self-conscious with ihein. Some teachers also use same ability groups. 
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Ho\ve\ (I w c an m^v it ami ^ci i t i^uiiig tlic gUM i \ al uc of ihv w i iiing 
workshop is quantity aiul immediaty of fmlbaik. I hc quality uf the 
feedback is not \e!> high, at leasi at fiist, and it is ne\ei as good as you 
lould punidc. l5ut it docs pro\ idi- a iead> <md re.spuiisi\e aiulieiice 
besides the teaclui, and it peiniits the writei to get almost iinniediate 
feedback the same day he writes or the next day. 

Conclusion 

.Measurement and e\alu.ition for wiiting iiuulve finding out what 
the students (an do when the couise begins (diagnosis), lesponding to 
their efforts and guiding thiii giowth (foinutue evaluation), and hnd- 
ing out how fai they ha\en)nie b> the end of the (ouise (suinmative 
measuiement). In thisaiticle 1 ha\e shown how we iiuist redefine the 
romentional notions of niasteiy learning and formative evaluation to 
suii oursches as Knglish teacheis, and 1 ha\e outlined foui geneial ap- 
pioaches to pun idiiig the continuous foimative lesponseaiid feedback 
young writcismust ha\i in ordei to grow as w liters. Theie is nothing 
technic al. I oniplii.uul, orsuipiisingin my recommendations. Oui ow n 
good sense as teacheis and wiiteis already points us in the directions I 
ba\e outlined. We know that composing is a complex personal, 
liiiguisiit. and social piocess lequiiing much piactite and suppoitive, 
helpful lesponse. \\\ know too. that gunvih is \eiy slow and that we 
must be patient. With persistence and ingenuity we can o\eicoine sotne 
of the school as-institutioii constiaints th.u frustrate us, and we can 
guide students' giowth in wiiting as ue know it must be done. 

Most impoi tant, we must gi\ e up being the judge and become the 
(oach or the listciui Soi ting, giading. lanking, judging all subvert the 
writing piocess. Wc mu^i coiuentiate on describing w hat students are 
doing and on cncoui aging their giow th, and w t must put off assignmg 
the public grades we aie still rccpiiied to give until giade lepoit time 
arrives. Even then, the giadc should be based on w illingness, on effort, 
and on giowth. 
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Recent Sources For \ 
Measuring Growth 
In Writing And 
Reading Fiction 

riioiuas G. Mac Lcnnaii 

While nKm> of ihv books and ai lit ks lisicti below ai c fail l> recent in 
oiigin, rhe concept uf nicaMuing grow th iii writing and reading fiction 
has been with us for some time. I'm sure that inan> teacheis have puzzled 
o\ er the problem of how to go about detei mining the status of a student 
who (omes to>ou in Septembei and lea\es in June. Just whatVneasuies 
(an we count on to determine the vital i|uestiun of detei miiung student 
giowih fioin the beginning tothecndof thepeiiodof timeinc|uestion? 

Measuiing giowth should not be confused whh "evaluation. The 
procedure of using the grow th measures to assign some number or letter 
grade which ostensibly reflects the quality of a student's performance is 
evaluation. Measurini; growth conceinsitself with thciy«/u/and reliable 
measuies we use in collecting infoimation about our students. If a 
measure is valid, it measures what it is supposed to measure. If it is 
reliable, it is fair and consistent w ith itself in nieasui ing w hate\ er it does 
measure. 

There are a numbei of valid and leiiable measures for writing and 
leading fiction and they aie readily accessible. If you are located 
anywhere near a university or college libiary, they aie available for your 
use as models in constructingyoui own grow th mcasuresTn some cases, 
I have added addresses just in case you want to add a copy to your own 
piofessional library. 

MEASURING GROWTH IN WRITING 

UlUi. Ru h.ird Jn lni.e\tt^iiatioti oftht tiuUns It hu h Affft t the i}ualtt\ of A^uni by Ad- 
Lamed i'hnemt'tii Studetih Ann AiImm.Mu htgan. rnncrsii) Muiufilnis. 1972, (.an 
i'( (M(li!ul fiijin I ni\(isit\ Miiiofiluis. l5o\ 17(>l. Ami Ailxu, Ma liii»4Ui J8iO() 
Ouin No. /Mliina ^ 

i )ntainsa veiy useful analytic scale foi measuiini|^rovvth in 
expositoiy wiiting. 1 am going to be using the iaiw, afialytu scale, 
seveial times iti this article, and Adiers is anexainpleof this type of 
scale. The complete published stale d(si l ibes tlu lugli, middle and 
low points for each component. 
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Qualiiv i)( uUms 0 I 2 ^ 4 6 

OcvrlopnuMU ()( ideas 0 I 2 I 5 

Oiganizaiion, n'lcvaiuc. movcnuMit 0 1 2 ^6 l 5 

Sivle. flavoi, iiulividualiiv 0 I 2 K 4 5 

Woiding (( lu)i(f of woids) ...^ 0 I 2 | 4 b 



(.hiiMUiiiMiK I'l.indN Ih< Pi<)l)U til i»! Dthhiui; a M,uur< SivU t Hiihsh J^}urnai ^7 
f \piil, VH>Hk |>i> *>72 '>7*l \ 

\ 

All ailu k' that o(ft is soiiu' siiggi stioiis iii iiicasui iiigt,* th in 
wiitiiig sl\k. C.hiisliaDsui suggi'sis thai llu most valid incabpic of 
in.itiiiii) IS not sum in I k iigih, but k iigili or ilic T unit, uliich he 
lit hius as iKini^i.K hiiMiiioi iiuk|xiuk iii clausc.Jogcthei with its 
MibouliiMii' rknunis. I U' ofkis iwu Inpotlicscs to he icsied: ( I) A 
inatiui' st\k uill h.iM a iclaiivi ly Ir^di fitquciuv of free inoilifieis, 
rs[jrciall\ in the fin.d posnioii. (2 I a st>k" will also have a 
ulativdy high fuqiuiuv of siuutuus.>f t •oidiiiation within the 
I -unit. Ik' ddlcis with kcUogg Hunts ti idiiigs on syntactic 
inatuiit\. (.hiistianscn fir Is ih.it a inatui -tvle iiuisl be easy to 
iliioili . I hi long I Luisi isn't tin m.n k of a iiUiUie sty Ic but of an in- 
ept st\ le. I Ik u.d piohkin is to pai k nuii L into little, "but to p.iik 
It so tint It I an be leailiK .inpatked," I oi aiiotliei view, see the 
Kellogg lluiitentiv *>rlov%'. . • 

(.oluii. Aithiii M ANNtNNHi^ Stiiddii nAImIuv to W iiU (.Ami\nMHuu^ '' Hesearih in the 

Contains .ui ex.uiiple of a die liotoiiioiis scale to be used in 
iiieasuiing giowtli in expositoiy loiiipositioii. This sc.de is useful 
w III n judginent iloesirt h.ivi to Ik u fined. An example, taken from 
Cohen's SCORK SilKt: I , follows: 

VKS NO 

Meeli.uiics l lieie aie many misspellings. 

I lieie .lie seiious punetiiatioii eriors. 

I lieie are eriois in the use of verbs. 

I line ai e en oi s in the use of modi f ieis. 



(.oopci. R Ml.^^ti^•h^ (.nm»li iii Wuunti f UiiUJi Journal f>HM^m\\. 197'») 

If \ ou only lead otic ai tu k .d)oiil ine.isui iiig grow th this y e.u, I 
would stioiiglv uionuiii nil this one. It should be le.id k)i a iiuinbti 
of ii.isoiis. ( I » It ofkis till i.Uioii.de k)i attempting to incisure long 
teim giowtli in .i i omposilioii piogiam, (2; it (jutliiies some lOiii- 
pi( liinsivi objettives (iiii hiding .ittitudr^al ones) and .i choice of 
idltd mk\ ivUablv nieasuiis you m.iy si kit to att.dii the ohjei lives, 
{S} iinpkiiuntatioii of tlu iiiiasuus leciums no speci.d training, 
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aiul. with the cxccplioii of ilu' »utitnde intMbiues, .ur taken fiuin j 
siiideiu's ongoing uoik and do not icquiit btpaiaic uslxji tjniz/.c\s, 
(1) the objc(ii\e.s do not dt^nnine insiiuciion, dn* classroom 
icacIuT is fiee to appioach iticni anyway diey see fit. 
NOTE. The emphasis in this entiie issiieuf du £;^^'/zA/^ Journal \b 
on measurement and evahiation. 

(.oibnK RkIuhI Hie Teaihifia, o} Urtttn^ itt Our SihiwL. Sv\^ \utL IhoMac.MdIan 
Coin pail). 

You might want to examine NCTE's, "Ideaforin" on page 84. 
It suggests an analytic scale (good, fair and pool) in measiuing 
growth in expositoi> composition. It is based on the following 
components oiganization, development, sinceiit> uf purpose and 
expression, sciuence stuuture and punctuation, paragraphing, 
usage, choice of words, spelling, penmanship and general 
appeal a nee. 



Dirdcfuh, Paul IJ ' lluw lo Mtasuit (.luwUi in W nuiii; AbiliU, htiiU^h Journal 55 
(Apiil. !%()). pp. Ur)-II9 

This article not onl> concerns itself wnh why we should be 
measuring growth in writing but contains u model we can use in 
measuring giouth ot the \\hole school composition program. 
Diederic h si^ggests using an anal> tic scale (high, middle and low ) ui 
measuring grouth in Geneial Merit factors (ideas, organization, 
wording and flavor) . Mechanics factois (usage, sentence struc- 
Uire. punctuation, sp^. . . g and handwriting). Hestrongly ad\ises 
total department involvement in ruling papers. 



Dutknili. Paul B Meaj^unni^ Cnui tli itt tMi^LJi. { iUaua. Naiiuiial f.tnincilof Itaclurs 
of hnglish. 197 1 XO IT, A\ajiabk fioin I K. 1 HI knivon Road. I'lhana, Illinois. 
l*iHV IS $2.30; nu'inhrr pricf is S21i5. ' 



A most infoimative and \aluable booK- Diederich suggest' 
se\eral approaches to easuriug giowth i]{ English, the reading 
lest, theoI>jective writii lest, a short test on knowledge of grainmai 
(the "shadow " test), as w ell as w ritten essays w hich are to be graded^ 
b> the entire depaitmeiit. Appendix A contains his analytic scale, 
desciibed in the pievious eiuiy. By all means. reac'/'InitiatingStaff 
Grading of Test Essays," on page 18, u litre he outlines iheiaiionale 
and strategy for w^hole dcpartnieiu grad'ng. 
NOTE. SeeKemieth Watson's papei in this issue f(jr away to imple- 
ineiu Diedericn's departmental giadihg scheme. 

I ul( V. Jt)s(ph J 'K\aliKaion uf I.tarnini; ni Wmnii;. ' Ilatulbuukuf fortnatwrafulSuttf 
matur tAnluntion of StudcfU Leornini^. Kdiini by Bnijannn A. BlfXJiii and others. 
New York. Mi Craw-Hill lUxyk C>)ni|)an\. 1971 pp. 7r)5«8I3. 
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\ o\v\ suggests that ( I ) w i .umI\ /i ilu kamiiig task. (2)oigani/.c 
ilu- task into scqutnnal uims» ilc\ist a table with desired 
ii)giiiti\e and affeitne behaviDis at the top and toiiteiit (he lists 
idtas. Digaiu/atiun. s;yk. tut i luniusaiui ihoiie uf woids) items on 
ihi suk^ { {} and then ditiiniine objeeti\es h) using the table in- 
liisiaionas aguuk. lU suggistsa tiipattiteappioaeh towritiiig. If 
voiiuanttouiitctlunicad uiiti' think. B> using the intersections 
of the table as a guide, the teaehei (an construct questions to 
uieasuie giowth. This essa> gnes nuineious examples of how to 
di\ek>p measurement questions and contains a comprehensive 
bibliography. 



C>Kt/ii. JiMii //u l)*\(Utpm(nt%ti the iAaur SnrnilK f i.ompoMiion ,Sirt/<*, Ann Aibor, 
IM> I5(>\ I7()l. Ann Arhoi. Mulnj^.ni 1810b Ouln No. 72- 1 190. 



(.ontams an anahtic scale designed to measure growth in 
student-uiittcii fiction. The scak has the following levels; plot, 
tluiiu , sutmg, ihaiatteii/ation and s'vle. Eaihof these levels have 
se\eial subkv( Is. I <>i details lefei to the measure. It utilizes many 
ixampks of stiukiu VMiimg to illustiate tlu high, middle and lov\ 
points on each level in the scale. 



Iluitl. KilK»i;i; W ijuanmaiuid Strmturts Wntttfi at Three (trade Levels. Nauonal 
(.ouiaiioi h.ulmsol Hi}*lish Ristarih RtpDtt .\u S (.haiiipcUgn, Illinojs. 1965. 

I Ins lescarch lepoit deals v\ith an instiumeiit to measure syn- 
lactu maiuiitv. Ilu nistiumentv\asdesigned tostud> differences iii 
M ntc nu sti uctuics among a he tciogciieous grouping of students of 
average I. Q. ni die 1th. 8th and 12th grades. Thedegreeof syntactic 
inaiuiuv v\as computed b> lounting the number of I" units (a T- 
umt IS a ilausc and all its modif>ing pliiases and subordinate 
ilauscs). I Ik stuil> (ktci mined that, ufx^n graduation from 12th 
giade. a stuck nt VMites r-units neailv GO percent longer than he 
coidd eight \eais earlier. I strongl> recommend Chapter 14. 
"Impluations for the Cuiiidiimn," pp. 155-58. See also the 
Christiansen enti\ above k)i complememar> measures of written 
syntactic fluency. 



Jmiiiu. SiMU M. iii J (fuuie for hiahuUin^ Student (.omfujstttun. Readtnss and 
Su^k*(stitms ioT tht luuher oj tM^lish i/i the junntr and Senior Ihi^h School. Tr 
hait.i. Iliiitois NaiiiMi.il (aniiu i\o{ U.ulH isui Liighsh, 1%'), Available from NCI' h. 
1111 Krnvoii Road Tibaiia, Illinois 61801 

Ihis lolkc tion of essa>s contains two composition scales.The 
Cahfoinia Kssay Scale, pp. I !7 138, concentrates on applying stan- 
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daids lo cuiium, org*mi/dUon *iiul style. While \i c*m be used foi 
e\aliulion, ilU iiuUiuro feel its best use Ksasa guide, '.i leniiiider of 
llie qucililies uhich distinguish supeiiur cuinposition.** The y 
Clevel.uid Heights-Um\ersit> Heights (Ohio) City School Dis^ 
ti let's, Ci)ni|X)sitioii Rating Scale, on pp. 159-160, is <i fivepoiijt, 
analytic .calc based on content, style anutuinentions. It lets a ^fu- 
iknti^*^ what elements of his work need sue. igtlu rung as well die 
areas lie has impro\ed upon. Although itean oe used as an evalua- 
tion deviec, it can also be usedasagro\\th measiue to show Mudents 
wliere they arc making progiess. / 



Kliiu.Julu I1u>inp>on 1 Ir S»ii<ill (^uniji AppuMililoWtiliiig. MttLwe for Measure. 
lxUU\\ by Alkn Htrgtr <iiul HlaiKlit II*i|>i Siiuih. I rUiiia. National C.ouiiul of 
Icadim ol Eng'iih. 1972. p\\ 32-35 

riiis article suggests using student evaluation as an effective 
growth measure. Whole-class meetings are reserved for gram- 
niatical and stylistic discussions of inexlel essays. By scheduling 
group conferences in a college composition course, the author 
found that the students ga\e each other a much broader audience 
llian the student- teacher duo allowed. I here was a significant in- 
dication that students wcic pieparing and refining rough drafts of 
their compositions. This type of meeting also enabled students to 
exercise critical poweis which could be then applied to.tJieir owir' 
work. ^^^^.^^'^'^ 

National Assessment of Educational Progress — liritms Objectives. Ann Arbor, 
Michigan. Commiitcc on Assessing ihe Progress of Education, 1969. 

iNational Assessment is a plan for, *'a systematic, census-like 
survey of knowledges, skills, understandings, and attitudes design- 
ed to sample foui age levels (Age 9, 13, 17 and Adult) in ten different 
subjcc: areas." Writing is one of the subject areas NAEP is concern- 
ed with, and writing exercises were developed to assess attainments 
$pecificd by one of the following objectives: 

(1) Wi.cC to communicate adecjuatcly in a social siuiation. 

(2) Write to communicate adequately in a business or 
vcx:ational situation. ' 

(3) Write to communicate adequately in a scholastic situation. 

(4) Appreciate the value of writing. 

It would be very beneficial for anyone interested in measuring 
growth in wiiting to become familiar vvith the objectives and the 
remits of the writing assessment. National Assessment has been, 
and to some extent still is, a controversial program. However, it 
does repiesent an attempt to deteimine, on a nation-wide basis, pre- 
sent status, past performance, and fuuire direction./riie follow ini; 
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rcpoiis aif a\ailal)U', loi bale, fioni the SiipcriiiieiidciU of 
DiKUiuciUs, r.sS. (»o\(iiinu'in Priming Olfitc. Washington, D.C. 
20102: 

ORDER NO. TITLE OF REPORT 

3 Writing: National Results 

5 Writing: Group Results A 

8 Writing: Writing Mechanics 

10 Writing: Selected Essays 

1 1 Writing: Group Results A & B 

NOTE. Foi two inteiesting \ iews on the National Assessment of 
Writing Skills see Henry B. Slotiiitk's. "On the Teaching of 
Wiitnig. Some hnplications horn National Assessment,'* and John 
C. Maxwell's, "National Assessment of Writing: Useless and Un- 
interesting?" in the Deiembei. 1973 issue of the English Journal. 

Sunitr. Dull Ami AiultiMiii. Ail. A MdhtKl fur ItaLhing bub^kilU iii CA^mrxibiiiuii. " 
hnghsh Journal >^ (February. 1969). pp. 252-250. 

An aiticle that proposes an error-counting scale to measure 
grow ill in the compositional subskill of mechanics. I he authors 
point out that the factors contributing to poor writing are: 
(1) Pievelance of "busy work" 

(2; Delayed return or non-ieturn of student compositions 
0) Scales that measure composition as a whole 

Thc> suggest two possible models for measuring growth in the 
elimination tjf mechanical crror.s from expository compositions. 

(1) For wilting .issignmeius of no more than a paragraph in 
length, they suggest a dichotomous scale in which a 
paiagiaph with no mechanical errors receives four andone 
or more errors receives a one. 

(2) lor writing assignments longer than a paragraph's length, 
thc\ suggest a four point analytic scale (erior free papers — 
I, one mechanical crior— 3, two mechanical errors— 2, and 
three or moie errors — 1). 



I uav. LiUui i <in Kaltm^ Smlc .\iin AiImh. Multigaii. riiiv(rsit> Murofilms. 1971. 
(miii hi ouIiimI inttu i luvdsuv Mioufilins. lUtx 1761, Ann Arbor. Midugan 
1810b Onlvt No, 7I-I()<)97 

An muusung liteiaiy rating scale designcnJ for use in rating 
eknuntaiy school (giades !-6) student-written short fiction. It isan 
analytic scale whicli suggests high, middle and low |>oints in die 
following elements, stiuctuie, ending, sentence structure, word 
usage, characterization, setting, point of view, conversation, detail, 
appeals to senses and values and situation. 
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M^'ASURING GROWTH IN READING FICTION 



CiXj|xr.Cii«iili^ R Meamrtti^ (,roulh tn Appreiiattun uf Literature. Stv,dik, I)c)iiudu< 
Inicrtuiitoiial Reading \i>tHiaiiun» 1972. Avatiabk ffuiii Iiiitriiaiiunai Reading 
A%%o<iaiiun. 6 I>u Avuuk. Ntuatk, Ddauarc I97II ^!cinbi'r^ pruc is JI.OO, nun- 
members* pi ue $1.50. 

A monograph wriiieu primarily for the researcher, but 
valuable lo anyone inieresied in measuring appreciation of 
literature. A number of auempts to measure appreciation of 
literature are reviewed. Also conuuns an evaluation of limitations 
and possibilities of the measures and specific recommendations for 
further research in addition to a comprehensive bibliography, 

(.ix>ptr, ('harlts R and Pur\o, Alan C A C»uuic tu ti-aluation, Ltxington. .\Kiss.. Oinn 
and C)oin|>tinv, 1973. 
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More than just a complement to Responding: Ginn In- 
terrelated Sequences in Literature this Guide contanis several very 
comprehensive essays about measuring growth in response to a 
literary work. In addition, it gives teachers some valid and reliable 
ineasmes for assessing growth. Cooper's essay, "Attitude Scales," 
explains the rationale and gives models of the Auitude-Sortand the 
Attitude Scale (pp. 22-27). Purves'/'Observation of Responses," ex> 
plains three systematic evaluation models. ( 1 j For determining both 
the variety of responses and degree of involvement in those 
responses (model is shown on page 29). (2; A model based on obser- 
vation of students' activities by adapting a behavior -content grid as 
an evaluation model (p. 30). (3) A classroom interaction chart (p. 32) 
which aids in assessing the interpersonal relations in the class. 

Examples of the following measures are also included: 

( 1 ) Interests Questionnaire (pp. 37-38). Aids in the determina- 
tion of students' likes/dislikes and interests. 

(2) Preconception Measure (pp. 38-39). A questionnaire that 
deals with preconceptions students hold about what they 
read and what they see on television or in films. 

(3) Reading Interests Questionnaire (p. 40). This question- 
naire seeks to identify students' reading interests. 

(1) Involvement Measure (pp. 11-12). Has the dual purpose of 
finding out (a) how readily students become involved in 
w hat they readand (b) what capat ities they have for reading 
various kinds of literary works,. 

(5) Critical Approach Measure (pp. 42*43). Seeks to identify 
the characteristic ways in which students approach the 
reading of poems, plays, stories and essays. 

(6) Student Profile (p. Ij). A form that is used to synthesize the 
information obtained in the previous rneasurel. 
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(7) Class CluiKUc Invcnioric$ (pp. 47-52): Measures that 
prov ide classroom itMchers a way to assess siudenis* percep- 
tions of your classes. P'or a discussion of these measures, 
refer to the P'ox and others and Gorman entries in 
MEASl'RING GROWTH h\ CLASS CLIMATE, below. 



(fUttCMiutii. Julia M. Making and Lvaluatnig I.Uaary .ScrapUx^ks/' Measure for 
Measure, hdiudby AIKnBtigu andBlaiichc \ lij\K SrnahA rbana. .NaUunalCuuncil 
of Tearhcrs o( Knglish, 1972. pp. 51-55, 

The author, a juiuor high .school teacher of English, proposes 
an outline for making and evaluating literary scrapbooks. Her 
scrapbook evaluation con tarns a dichotomous scale to measure the 
mechanics, and an analytical scale to measure the content. 

l.uUiii. U aiiti, Ry.m. Maigaiti, and Squire, Jame!> R. T€a\.htn^ Language and Literature. 
New York: Ihircouri, Brace and World. Inc., 1969. 

I his general mt tlyxls text has a plan for evaluating growth in 
four important areas, ability to interpret behavior, sensitivity to 
form and style, grasp of ideas and theme, and growth of personal 
tastes. The section of the text devoted to evaluation of literature (pp. 
r>b2 569j contain some helpful models for constructing the follow- 
ing opinion polls, open-ended responses to a reader's response to a 
literaiy work, summary of voluntary reading, and self-evaluation 
instruments. There is a particularly good interest survey (p. 547) for 
gauging prevailing attitudes and tastes of students. 

Mutkii. James. ./ Studeni Centered Language Art^ Currtculutn, Grades K-13, A Hand 
booh for Teachers. New York, Houghton Mifflin Company. 1968. 

Moffett feels that the administrative need for tests and marks, 
has tampered with educational processes, especially in English, 
even more than most of its critics have ever asserted.'* In his 
"General Orientation'* section of this volume, he does offer a 
method by w Inch teachers can evaluate grow th (p. 7). He feels that a 
folder of each student's papers should be kept and passed each year 
frurn teacher to teacher. Growth is measured by general assessment 
and teacher observation of the student's oral and dramatic work. 



iSatumal Assessment of Ediuattonal Progress^Ltterature Ohjecttues^ Ann Arbor, 
Michigan, (.onnnuux* on AsH'ssing xhc Progress of Kducauon, 1970. 

For an account of the scope of the NAEP and where you may 
send for reports, see entry in MEASURING GROWTH IN 
WRITING above. The NAEP literature objectives are: 
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(1) Read liicraiurc of excellence. 

(2) Become engaged in, find meanings m, and evaluate a work 
of liieraiurc. 

(3) Develop a coninunng mieresl and panicipalion in 
liieialuie and the literary experience. 



In addition to a detailed explan.ition of these objectives and 
how thc> appl> to the four age levels (9, 13, 17 and Adult), the report 
contains specific measures for literature. Anyone interested in 
nuasuriiig growth in litciaturc should know the following reports. 

ORDER NO. TITLE OF REPORT 

02-L-Ol Literature: Understanding Im- 

aginative Literature 
(Theme 1) 

02-L-20 Literature: Released Exercises 

02-L-02 Literature: Responding to 

Literature 
(Theme 2) 

02-L-04 Literature: A Survey of Reading 

Habits 

(Theme 4) 



Purvcs, Alan itdj llou Ponuptties Mah l -^r. Soies on a liespome Centered 
(,urr It Ilium. Uxington. M.issatluisctts. Xerox (A>!it'ge Publishing, 1972. 

I highly recommend, as a good starting point in measuring 
growth, Pui ves' essay, "Proving That You've Done What You Sef 
Out To DoAndThat It's All Been Worth It" (pp. 181-199).Thcrcis 
also a very comprehensive evaluation and planning bibliography 
on p. 216. 



Puivts AI.iii (. hvalu.iuoii of L(.tiinii.i; in Lacraiurt. Handbook of toimative and 
Sutnmatue t^aluation of Student l^arntnt^. LdiRii by Bcnjanun A. 1 ItK^in and 
others New \ mk Mc-(»r.jw Hill Book Company, I97I. pp. 698-766. 
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In atteinpung to deal with the complex problem of construc- 
ting objectives. Purves i.uggests treating a grid with, "content on 
one axis and behaviors on the other, and determine from the grid 
those cells (or content-behavior intersections) which seem to be 
eniphasi/cd in a particular class, school, or curriculum.** He in- 
cludes a tabic (p. 701 } to illustrate this process. The essay deals with 
detailed exfjl.ination.s of hcJW to go .ibout measuring response to 
liteiatuie. Purves shows how to construct measures of knowledge, 
usually cjuestions of recall and recognition, which may be easily 
cast as multiple choice cjuestions. He points out that cjuestions of 
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application ukt two forms, objective .mcl essay, boili of which ask 
the siudciu lo match tuo pieces of knowledge and determine 
significaiu relationships. He outlines questions of expressed 
response which look at the re-cieative or the expressed response to 
pic(t<i of fiction. Questions of participation seek to deteriiiine the 
relative weight of an interest in litciatureamongadi\e!sity of com- 
peting interests, and which seek to determine the depth of interest. 
Tlie essay includes numerous examples of all of theoe measures. 



/ MEASURING GROWTH IN CLASS CLIMATE 

Doyno. Victor "Knglish Coiiiic E\.ilti.itiuii. " Meoj^xire for Measure, hditcd by Allen 
Bcrgn .md Bl.mtht' no|>c Smuli t'riMiu. Naiiuihd Cuuiu iluf I fathers of tnehsh 
1972. pp. 97-98. ^ ' 



Tlie author asks students for an anonymous evaluation of his 
course after about 5 weeks of class meeting. The evaluation centers 
around questions such as. What is your attitude tovvard the course? 
What should get more emphasis or attention? What could be done 
to improve the course? At ihe end of the course, he poses further 
questions to the class such as. What should be ^changed? What 
sliould remain prcity much as it was this semester? These final 
evahiations arc also anonymous. Formative responses (during the 
course) are an aid to the instructor in case he w:ants to alter the 
emphasis of the course. Summative (final) responses aid him in 
teaching the course again. 

rox.Rolxitandodtcis Diafi^Hosmg CJasiroum Uaniing tnvtronments^CUKa^o.hcieiKt' 
Rt'seaich Assoc iaies, 1960. 

Includes over twenty five measures of classro<>m climate. Also 
includes the rationale for paying attention to stud(>nts' responses of 
how they perceive classroom climate. This volUme contains a 
questioimaiie to determine how the class would like the teacher to 
act in the class (MY TEACHER). It asks students ip give you some 
feedback on how they perceive you. Another measure, HOW THIS 
CLASS PTELS, provides information on students* perceptions 
about the class in general. PUPIL PERCEPTIONS OF A CLASS 
PERIOD provides information on students' perceptions of a single 
class meeting. NOTE: These measures are also contained in the 
Ccx)per/ Purves, Guide above. 



(tonnaii. Alfred Teachrrs ami Uarnrrs, The Interactive Fruiess of hdxtcatton. Boston 
Atlytiand Bacon. 1%9. 

A very iielpful volumeof measures of class climate. Contains a 
measure to gauge students' response to a single class meeting. Also 
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piovides tin i)iiKkm ilic uppuriumiy lucurnmcni on uhat lie she 
can do to improve ilie class (CLASS MEETING REACTION). 
There is also a \er> good measure of determining uifoimation on 
siudenis' perceptions about the class in general (REACTION- 
NAIRE) uiiicii asks for student comments on tiie following 
questions. How would you desciil/ >our personal auivity? What 
has been y oui reaction to tiie class tiiu^ far? Is it meeting your needs? 
VViiy or wiiy not? How could this class be improved? What is on 
your mind tiidt you wisii you could say m class? NOTE. These 
measures arc also contained in the Cooper Purves Guide above. 

SUNY, Buffalo 
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R + NR = ? 

by 

Patricia E. Moore 
and 

John T. Chamard 

Oncuf llic Lltinal argiimcnlj) in cducaliuu deals with the validity of 
heterogeneous grouping. Our school has been involved in 
huniugeneous giouping foi many years. Four years ago vve introduced 
an elect nepiogiani ni English foi seniors. Some of us thought that these 
elective classes should be heteiogeneously giouped much to the chagiin 
of several of our colleagues. These teachers thought that the better 
students would be held back with such an arrangement and that the less 
talented students wuuld be inhibited by the presence of the more intellee 
iiial. VVt fought this argument because \\q did not think this would 
hapfx-n and fmtherrnore these seniors would soon be going out into the 
world where it is necessary to communicate and work with people with a 
wide variety of educational abilities and backgrounds. We were certain 
that It was important that we do all that was possible to better prepare 
these students for the "outside" and that this was not being ac- 
complished with classes designated A, regents, and non-regents. 

We were able to influence the members of the English department 
enough so that they were willing to try it "our way." The transfer from 
homogeneous groups to heterogeneous was not easy for some students. 

"We're just 'NRs' (non-regents). We can't do stuff like that," a 
senior from the back row groaned about the requirements for one ten 
week elective. Other vuices joilied in angry agreement. This was the first 
time in three years or mure that our English students had been in mixed 
ability groupclasses.Laterinanafternoonclass,avery nice, very serious 
regents student came up after class and said, "I guess we won't do very 
much in this elective with those kids in here." 

These feelings, however deep, came to the surface on and off 
tlirough the year. There is no way to know if any changed their feelings 
about themselves or others, but it seems that three years of separation 
into A, regents and non-regents groups had an effect. 

Tracking has been justified as the champion for "letting each 
become all he is capable of being." No more teaching for the "middle of 
the road, ' the high ability students aic not held back, their intellectual 
curiosity is challenged by a eurrieulura that demands their best effort. 
I he lower ability students are not frustrated by a curriculum that flaunts 
failure. They are not constantly reminded by the presence of brighter 
students that their answers are less substantial. 

These are some of the positive points for tracking. (I remember the 
fi ustra tiun of teaching a class of 30 ninth graders w hose IQs ranged from 
90 to 180.; The present system of tracking however, presents almost as 
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man> iicgaiivcb. Luwa Hack (XR; cunicj) to mean. "I am not bright 
therefore I am nut a vahiable per sun. M> ideas are nut wurih as much as 
those in the iippei groups. I am not worth as much. I'm not going to try. 
Wliat's the sense? Who will respect me for in> accomplishments?** 

Tracking is supposed to be h.ised on ability, however, it is in- 
teresting to note that a majoiity of our lower track students ha\e some 
common ground not shared so noticeably b\ the upper tracks, ihey are 
most often the students who break school rules, they often end up on 
detention, suspended, expelled or they quit school, they are seldom in- 
volved in extracurricular scltool activities, they don*t usually hold of- 
fices in school organizations, their over-all attendance is poor, and, in 
general, they lose most popularity ty pe contests. There are also a number 
of students who end up in non-regents classes who are not incapable of 
doing regents work, but because of la/mess or discipline problems they 
have wangled their way into a class that is easy for them. If they were 
A\^Am forced into a class w ith the belter students, might they not benefit 
with more acceptable work and discipline due to peer pressure? 

Tliese obser\ations and the responses to our heterogeneously 
grouped senior electives prompted us to consider mixing the 
sophomores for two short units during the year. We outlined a plan for a 
research study to use four of our classes in the spring for two, two week 
units. The first was a !>peech unit and the second a travel unit requiring 
reading and writing skills. We combined two classes (one regents, one 
non regents) into the experimental group, which was divided into two 
sections. The other two (also one regents, and one non regc.its) remain- 
ed intact as our control groups. 

We drew names out of two hats to create the two experimental 
groups. Each group had approximately thirteen regents and thirteen 
non regents students. We gave the students a simple explanation about 
being tired of the same groups and sent them off to the other class. No 
one juestioned us. A few grumbled about having to get up from their 
comfortable slouches to go to a new room and a few others looked a little 
anxious, however, they did cooperate. 

The first unit required each student to prepare and present to 
the class a demonstration speech on a topic of his. her own choice. It is 
our feeling that this type of speech is least fi ighteni rig since the speaker 
lias something to do with his hands, a specified process to follow, and an 
end result to show. All students had done other types of speeches earlier 
m the year. Topics chosen in this unit included changing a flat tire, 
making Jello, tic dying T shirts, fly fishing methods, candlemaking 
and a variety of sports demonstrations. 

All students were rated on a 1-5 scale in four areas: opening, 
development of point, conclusions and delivery. The results showed no 
significant difference between the control and experimental groups in 
any of the areas or in the totals. The ev idence of the control group seems 
to say that the regents students in the experimental group functioned at a 
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nurnuil Icvtl, ilu> didn't ii) kss hvLMsv they received little tn nucuin- 
petition, but lathei diey \vuiked»it theii usiud level. This vv»isalsu tiiieuf 
the non-regents. The c\pcrinient*d giuup \v*is nut inhibited bv the 
regents students and (ontinued to work at their usual level. 

In general, student.s in both giuups feel piettv much thesanieabout 
speeches, they don't like them. I he uon-iegeuts students seem to hate 
them less than the regents, peihaps because oral comnumication is 
emphasized in then curiiuilum. Mu best sioieiii one of thcexpeiimen- 
talgioups was made by a boy legularly in the non-regents class. At the 
same time there were three non-iegents boys in the expeii mental and 
control groups who stayed out of school most of those two weeks to 
avoid the speech, tlicy had also done this earlier in theyeai befoie thisex- 
pciiment. 

rhe second unit, the cumpiling and writing of a tiavel brochuie, 
!»taited right aftei oui twoweek spiing vauition. This unit requiicd the 
students to set up a 52000 vacation pamphlet in process f um. Each stu- 
dtnt chose his destination, computed the distance and cost, decided on 
siglits to see, found accommodations and costs for everything and 
oigani/ed a daily itinei.iiy. Some students were quite creative, some of 
them weie not. This was an ambitious- pioject and the ambitious 
students in both groups were the inoie successful ones. 

For the brochure, students were rated on a 1-5 basis iiyseven areas, 
attractiveness and usefulness of cover, general in format jon, organiza- 
tion and detail of text, overall appearance, and originality^. The first and 
sixth categories were meant specifically to give someone credit w ho tried 
hard but had difficulty with reading and writing skijls. The statistical 
data showed jio sig.uficanl difference betvveen thcyexperimcntal and 
a^itrol groups in any of the areas. ' 

Both of these units required individual resc.^j/ch, preparation and 
performance. The fiist day in each unit consisted of general lecture, in- 
stitiction from then on was individualized. Perhaps peiforniance of the 
expel imental and control groups was similar for diis reason. Perhaps 
this in part accounts foi the fact that academic sticcess in these units did 
not diieetly coi relate w itii tiack level. This is the way we hoped it would 
work out. 

\\\ were coiuerned that mixing the classes for the experimental 
gioup might caust the lujn- regents to feel less successful than in their 
original groups. That is why we intioduced the CALIFORNIA TEST 
Ol' PERSONALI FY, A PROFILE OF PERSONAL AND SOCIAL 
ADjrSTMEXl' which measured feelings in six aieas, self-reliance, 
sense of personal woi th, sense of peisoiial hcedoin, feeling of belonging, 
withdrawing tendencies and ncrvotis symptoms. 

Fhe day befoic the new class gioupings were announced we gave a 
intjdified vcision of this self imat^e test. a\o names wiic used on these, in- 
stead sttulents identihed then tests with thei; biith dates. This same 
jnetliod vvas used on the post test so that changes in responses could be 
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noted. The pre test scores fur the regents students showed they already 
had a more positi\e self image than the non-regents stiuleius. It was nut 
surpiising to find that iht regents student feh better about himself than 
the NR. At the end uf the experiment, when the students again took the 
California Peisunalii\ test, the data showed some significant changes. 

On variable fi\e, withdiawing tendencies, the regents control group 
showed an impro\ement from the pre- to post-test that pioved tu be 
malhematicalU signific^mt (7. 1 1 to 8.00). Although no othei individual 
\ariablepro\edsignificanLfor-this group, they showeda measuiable un- 
jpi()\ement of self-image at the end of the expeiiment (52.81 on pretest to 
55.29 on the post-test). 

hi the area of ner\ ous s> niptoins, \ ariable(3, the ' agents expei imen- 
tal group showed a significant improvement (8.^'^ to 9. 13). Again, even 
though the otliei \ariables showed no significaiii impioveineiit, the test 
as a whole showed significant impioveineiit of self-image (52,18 on 
pre-test to 55.04 on post-test). 

The noniegcntstontrolgioup showed no significant differences in 
any of the individual areas or on the self-image test as a whole. 

Although the non-iegenis experimental group on variable six, 
showed a signif'tanl difference (9.07 to 8.13) which indicates a greater 
tendency tow*ud luivous s>intoins, the overall test totals for this group 
showed no signifieant diffeieiice. 

It appeals that academically the two groups' functioned in then 
usual inaiiiiei The inclusion of a liigliei ability gioupdid not frighten 
Of stifle the lowei abilitv students while the regents students aid not. 
lowei tlieii staiidaids. riie iiidiv idualized type task required in tlii^.uhit 
kept (lass iiiteiactioii at a iniiiiinuni. Cla. ^ discussion, .small group 
w oi k. formal testing w ue not a par t of this unit. These tv pes of tasks may 
be mote tliieateiiing than those used in these units* 

An oveiall look jt the self-image appeals to show legeiits students 
in l)otli the experimental and control groups feeling better about 
themselvis wliilt iht iion Kgeiits self v iew did iiotcliaiige significantly. 
We leallv did expec t a change for the iioii-iegeiits one way or the other. 
Mavbc they hav e bottomed out hy the time they i each sophomore y .ir, 
ina>be only a continuous mixing will luve any effect, maybe they've 
built such solid walls that only dMinalic failuie oi success can effect 
them now, ina>be umv vou'ie labeled, vou're labeled foiever. It un- 
doubtedl) would take inuie than a foui week experimeiii to produce a 
significant impioveineiit in self-imagc foi these iioii-iegeiitsstudciits. It 
must be stiessed. liowevci. there was no dec lease in self-image because of 
tlieii exposuie to thehettei students which suppoitsoui theory tliatNRs 
will not feel inferior because of exposure to Rs. 

We had scmie peisoiud cjbseivatioiis not suppoi table b> data which 
were inteiestii.g t j us. Theic weie nveial ticjublesome students in the 
non regents ex| viinuiilal class befoie we mixed them, who modified 
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llu'll Im'Iuimoi to M>iiuiluiiv^ iiion luului .K(ipUil)U. Out iioii ri\mius 
\)0) in llu Lxpti iiiuiilal i Liss \\ ho h.ul Intii U)lall> sikiu u.ii nuidc 
fiu'mlswuli iliui i^iiLsf'oni llu rimiils cLibs, iiukd up d.itinv^ uiu and 
staiu il p.ii lu ipatiiii; in ( Liss ilisi ussioiu. Oiu sli\ quid Nouiiv; Lid> in 
llu' lUHi-irm iilMLisN In uiini out uf llu luosl prpuLii sliuk nis in iht i\ 
pi'imuiiLiU Liss. I hisolmi\4Mi)ii In llu Uarlui w.isfuillui mij. A)iU*d 
by ;i io-giani given Mih'r end f llu" cxpciinienl. 

this MHio-gi.iin sluduil.s hi liu i xpti niunl.d ilas.si: chosi fi\c 
olIu'Us Uom llu I Liss Willi whom llu\ would liki lo work ii. d»v ;u\l unit 
of siud>. U I diMo\ »nd lhaiall sUukiiiswm' inrhukd in llu mk io gi.im 
ami llu'it w.ih aguai J of iiuxnigof iigtnLs tiid ikjii icgi nissuuknis. 
Tins punul lo us il *• t \\a» nnuh U) Ik gained sociall) in mixing 
llu* iw'o abiliiv gioiips. 

Il smns llu K .11 V g.uns to Ik ni.uk .ind hllh lo Ik losl in bicaking 
gioujjing b.ai uis k)i slioil unilsof ihis l\pc .il lliis kvcl. As a icsult of 
llns ixpiiuiu III. wi .IK now iiivoKiil in .i fifutii d.i> uiiil ih.il iiitUuks 
A, U'ginls. and iion-ugu* s soplioiiioii sliuknls. This gioupiiig tUii 
upl will Ik upuiud al k.isl oiiu iiiou duiiiig llu pnsuil school >c.ii, 
I nfoiiuiiau K u isii i >i i a u.ilii> kji du junior >c.ii \\\ . .111 oiil> guiss 
.iboul senior iluliMs foi L.;si sophoiuous. Ob\ iousl>, ^inuih will dc 
puul upon du kind of u\pii uiuis llu> Ii.im in dust shoi'l iiiixal uiiils. 
l aiis .ind !i.Ui,ts w dl Ik Liniih.ii wliuli !ii.i\ hi Ip :^ die known ic.dl> 
less fiighu'iiing ilian du* unknown. 

Hopifud\ .iiin.il in du noii-gioupcd saiioi ckvlive piogr.iiii will 
noi Ik siuli .1 sIuk k foi ilusi sliuknls, .ind uiir.intt lo du- red world of 
woik.iiid lifi iii.i> Ik uisiu foi ihosi who iiiusl tioss al! kinds of group 
bail u is lo sua ml. Iiuiusli >, go\ i iiiiiu ill, idiu. ilioiidtpiiidon.il I l>pcs 
ol skills, .ibiliius and pusoii.ihius for du 11 sutttss. M.in.igcnuni must 
Ik .ibk to loiiiniunu.iu wiili l.iboi .iiidvui \Lrs.i, If wt (oinp.irinicii 
i.di/.e, dcparunenialize, ir.uk and, in faci, build walls in the education 
(hat iiiusl (should) U biokiii down ouisidt llu si brie k edihces tli.in we 
.lie iu>l ediu.iiuig whole piopk foi whole h\ iiig. Hu iieiglibois iiexi 
(l()oi» aie ilie\ A's 01 NR's, (ku's 11 mailer? 

Oneonia High School 
Oneonia 
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Putting Cloze Into 
The Classroom 



by John h. Ilaskdl 



ESI. ic.ufu'is icgiiliiilv f.ju ihi pujhk'm uf sikiiiiii^ luulin^^ 
uuuiials ihcil uill luul lluii sliukni's luuls cUul abihtus. M.uukiIs 
picpaial foi ESL siiukius ait ufim iksij^iuuid as Uuig .u sunu wuul 
level such .s the l>000-\vord level or the2,500-vvord level or areprcpaitd 
(oi tnoii gcneial usi i^unips kiiovsn a;> "mtniiudum " oi ' ad- 

vanicd" level sliidenis. Bui it ii, diffiudl to diluimiK aiiuiatcl> v\Iuh 
iIk students aie in lUatitJH tu thusi k vds. Readability fuiiiudas, v\hu h 
might help, aie not appiOpnate fui elassiuoin use as thev au both tu j 
KJUiplicatcd and tuu tinu lonsuinin^ tu u.st . In additiuii, iuulabdit> foi- 
nndas aie genriallv designed tu lueasuit inatuials u.sed with native 
speakiis and aie inttipieted in terms ufj^iade level. .Sehool giade levels 
aie not easilv applied tu hy \ stuck nts and tertainiv nut vsith the sani' 
meaning. 

/ * 

In miermediati ui advanced icaduig* lasses it isoftc i^tl^e piaetue to 
ask students tcjsdc ct suinc thing tu lead i>utsuk uf elass. 1 hK ina> seem 
to be a v\a> of piuv iding motivatiun fui leading— alluv\ uig tlu student 
to elioose for himself— but, hov\ inan> times have each of us stuuci in 
fiuni uf a laek uf bucjks in the aii purt oi at the drugstoie and betn uihibk 
to seled a book to lead — sexy covei or no? 

VVIiai I wanted to find, in my attempt to solve this problem of se- 
lecting reading material, was an effieient method that any classroom 
icaehei could use. .\ luethud lu incasuit mateiialsfur level uf ieaclabiljt> 
v\lucli v\uukl alsu help the tcachei ek teimine tlit apprejpr lateness of the 
materials for use v\ ith a spec ifie gunip uf students. It had to bealso, e.is> 
toprepaie, e^isv tu give, aiuUas> tosiure. What I found was theCLOZk 
pioc ecluie. 

The (Mo/e pioe ecluie foi measi ling ieaclabilit> was first suggested 
bv Wilsun I'a^lui as a means of evaluating materials foi nativelCnglish 
spcakeis in It has since been used with Japanese, Korean, Anduric 

and uthei languages as well as MSL. In Icjokj^ng at vaiienis studies of 
(!lu/c v\itli KSL stuekiits, tu eleteiinine wUkli pioceelures would be the 
must effie lent and still prae tieal tu use in the e lassroejin. I found a w ide 
V ai letv of pioe eeline s use el, v ei > fe w of u liie h were sele c ted on ihi basis of 
any tested evidence. 

riie CMo/e piuieekne is basi(all\ the deletion uf ever> Nth (3th, 7th, 
lOth oi the like) wuiel fiuin a puitiun of the mateiial tu be evaluated,-^ 
which is then, in its inutilateel fuiin, given t(j thestnelent. I he student is 
asked lu lestuie the te\l b> leplaeing the blanks with the appiopiiate 
words— b> guessing, fiom the luiUext. I'lu tlieury is that his ability tu 
resture the test is a measure of the appropi iatenessof the niateriai ftJi the 
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simk Ml U; u .ul. Km i pi ui ilu i »isi s lif bKiiik K ni^lh and t> pc of scoi ini^, I 
(uuiul liu Khcaitli upuilitl ii) tklmmni CIok puHaluiis to be ua'd 
willi KSL siudi'iits. 

\s A u'sidl, iwi) sliulus Ui i\»diKUi Clu/i' testing »iiKi scoring 
pHxalu.vs uiit uiukitakm tuditiinmu whuh wuuki bc inost uscfu! to 
llif t Lissuhjiu tuului in si kiting uadiiig iiMttiial fui ESL student^^ ^ 
1 \\v kjlamuiK stati Hunts Ixisedun tone lusiuns diaw n as a result of 
(hose studies. 

1. Dektion Rate. Man\ iiseauhcis, HKkuling John Carroll and 
DiHiJiUn DauRlstin si ant d io feel that fuicign students should he given 
as imuh nifuiination Intween tl. blanks uf a Clo/c test as is practical 
ahe\ ha\e useil a deletion lati en lOth word). I found, in testing 
\aiions latis, that, as w uh natne speakess, passages deleted of every :nh 
woid pioduud the same statistical lesults, that is, provided the 
(lailui Usiaului with tlu saiiu infoiniation about the readability of 
the passage, as when those passages wtie deleted of ever^ 7th word or 
t \ 1 1 \ lOth w Old. StudeiUs did not tend to seoie ain better when they were 
given iiiiK wouL between each blank than the> did when they were 
gi\en unlv foui wuids Ixtwcen each blank. (Fewei than four words 
between blanks, howf'vei, did aff'xt lesults.) 

l oi tlassHHjin use. tlu dek tujii of c'vei> Jth woid is, then, the most 
I Ilu K nt i)\ 1 1 cjiioiiiical dt k tioii lati lx\ ausc. foi a standard fifty deletion 
passage, itallo\^stht ttaclui to Use ashoitei passage and still maintain a 
sulluu nt iiiimbu of ddttions foi measijing. I he time needed for test 
piepaialion is also less when only eveiy fifth word is deleted. 

2. Deletion Type. The mechanical deletion of every Nth word is 
w hat makes the pioti duu woi k is a leadability or proficiency testing in- 
stiuiiuiit. SckctiM dektiuiMtliat is, deleting only nouns, pie|X)sitions, 
i)i the like) changes the chauutci of the test horn one which tests total 
language competence to one that tests the ability o{ the student to 
lecogni/e and us. woids in a giammatical context. 

S'.;me leseauheis ha\e been botheied' by the fact that certain 
luimerual liguu sand piopci noiiiio, when deleted, were nearly impossi- 
bk togutss toiut tly . With natne sjnakers, when unguessable numbers 
i)i piopii luniiis tuin up in the piocess of deletion, they arc generally 
skipped and tlu luxt woidtkleted. Counting continues from the dele- 
lujn. 1 his pUKcckiie tloes not distuib the mechanical nature of the 
pioccduic. when used with KSI. stuck n ts. noi du^ value of the test results. 
But u was also found that the ine lusujii of twooi thieesuch unguessable 
wolds, on any gnen fifty deletujii test, did not disturb the test results— 
especially when tlu7 aie used to evaluate group scores. 

J. Niiinbei of De l( lions. Mcjst of the studies with native sfx^akers 
leccinmund a iiimiinum of fifty deletions for a Clo/.e test. In one study 
with KSI. students I used passages with a lange of thirty-five to se\eniy- 
Ine deletions. (»iven the mat? iials used (selections from ESL readers). 
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ihv 'lumber of dcliiioiis. uiihin this i.iiit^i, ihd not strm to .illut Wbi 
irsulis IIouTMT, irsl moiis Ixisul on fift\ dcKlioiKs pioval to Ix* inoii' 
easily (oiucrtul to pn(c'iu.ij,'r stoics. dtUtions also imrts most 
icscaich iimls (or leiii,'th. 

I. Test Lnigth. Giwu tlu [HOdduus luomnuiuk'd alK)\e(.uk*k*- 
lioii lairofevciv Jih uoid, nuc lKiiiiudl) dt k ted, w ith .i iiiiiuinuni of lil- 
l> dck'lioiis) the a\ei.ii,'e test length shuidd ht appioxii]iatel> 2:)0 uoids. 
(Approximate^, since it isalwav.. best to take the passage to the logical 
end of a sentence latlu r than abi iiptl> end u ith the fiftieth deletion.^ loi 
the classroom teacher this means that a singk test passage (an be t\pe(l, 
double-spaced, on a single |)age. 

3. Blank Size. The studies (k)ne on C\o/v testing pUKeduies (on- 
firmed Jonathan Anderson's previous leseauh which stated that the 
length of the blank which lepLned tlu deletal woul did nut affect the 
results of the tc*st.' That is. blanks of eithei unifoim length oi \aiious 
lengths (either c onfoi ming in some wa> to the length of the woid deleted 
or ioilieie(|uireinmtsof thet>pi wiittenpage)can be used. Kui theimoie 
the leachei ina> e\en blank out ihe words on tiK oi iginal inatenal lather 
than type up die passage and either test it that way, or, foi a group of 
students, have the page reproduced b> some mechanical process. . 

6. Scoring Pioceduie. Research on Clo/.e scoring proceduies with 
ESL students ha\e dealt with thue basic ^coiing methods, '\'e/batiiir' 
(or exact'W'orcI) scoring. ".S>non>nr' scoiing, and "Othei-word" scor- 
ing In Veitabim scoiingotd) those wuicis tliat occui in theoiiginal test 
are acceptable. In Svnon>m scoring, s\nonyins of the exact woids are 
also accepted. In Other-word scoring, any appropiiate woid thatcjccius 
and continues thegeneial meaning of theoiiginal text is accepted. In all 
cases spelling is not consicleied impoitant. 

For the evaluation of scores foi a gioup of students on any given 
piece of material, Veibatim scoring provides about the same uifoima- 
lion about the READABILI'l'V of the passage as the otiler two scoring 
methods and is theiefore preferred fcji use by the classroom teacher 
btccause it is more objective and takes less time to vcorc.{l'hisconclusiou 
has more recently been c onfinned b> Kiashen, Zelinski. and Jones ^md 
in a personal communication by John Oller^ 

We assume in testing, that objectivity is what we are aiming for. I 
found that foi measuring the readability of a passage for a group of 
students, the Verbatim scoring iriethod was the mcjst Dbjec tive and the 
most efficient to work with, miis is paituulaily uue when the blanks 
on the dek'ted passage aie nainbcred in some way.) I heie is no need to 
evaluate eac h answer for its appiopriateness as is the case in both of the 
other scoiing methods cHsc ussc d heie. A single list of the ck leted words 
can be used instead. 

On the other hand, foi inteipreting individual scenes, objectivity 
may not be the important factoi. Individual scoies may vaiy widely clue 
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U) ilK tiilitHiKis Ml kiu)\vUtl,m 1)1 MH.iljuLii), oi giaiiimar, expcficncc 
oi iniru'si. I luit iiuliNuliials. loi loiis uasons. ina> havcinore 
oi U-ss siu 1 1 s^ \Mili liu iiiau > lal nia\ not In as impoi laiii to tin* tcac her as 
iluM)\ri-all a|)|M()|)i lauiussol ilu malt iial foi tin w hole class or gioup 
ot simK-iils. iiui ioi iiuin ulnal tluij^iiosis ol a ( -lo/r irsi ilu' OiIut-wokI 
Moiiiii; iiu'IIuhI \)U)\ uKs ai;uai( i aiiu)iint ol mioiinauon with which to 
anah/r ihi siiuUnrs slu UKlhs aiul w cakiu ssi s. Olhn-uoid scoring is 
inoK^ subjective and olicn not scored consistently but it docs provide an 
induation of vocabulary sticngth and versatility as vvcll as helping the 
leachei detcrnnnt specific grammatical and semantic problems of in- 
dividual students. 

7,. I'valiiauon. No uscanh has been repoited that establishes 
evalii.rtnjn ciiuna loi (.lo/c icadabilitv testing with KSI. students, but 
soiiu use lul gc lu lah/atioiis t an In made fioin piotediires used for nativ e 
Njx.ikt IS Jouatliaii AiuU isun siau s. w itliout pun iding anv research in- 
toiiii.uioii. that Ik IouiuI ilu gciuial tritciion levels estai}lished for 
native LngliNh spiakcis U) In a[)pi()piiatt loi KSL studenisJ' hi geneial 
ihev aie tin li)llowiiig sc on ^ of jIVu i)i above suggest that themateiial is 
Miitable liu siudt lit U) lead indtpeudentiv, scoies of between Hand 
j.i'o mditate that the mateiial is MutabU loi insuuetional use— in the 
dassKHitiKaiul s(e)ie sin lt)V\ 1 To induate that themateiial is too difficult 
ii)i ihesiude utaiielw tlloiilv [)KhIik( liustiation. riieseaie geneial areas 
and die icM^bei uiav v\aiu lo adjust them sonu^vvhat. 

h should aho In kept m mmdjhat the newness of the Clo/e 
pioeeelun itst ll iiiuV alle 1 1 se oie s the I nst time oi tw o it is used. Mcjst of 
tisaieiise el loihe idea that 100% is possible and the aim of the student in 
lesimg. Ilu (.lo/e pa^sag^ isiiola test in this sense and it should be made 
( ieai. thai, in ge ueial. a i^ be ing usiel tomeasuie the RKADABILI TY c^f 
duinauiial Jiid not (lie u ad nig abilitv of the student. .\ score of 100% is 
Inghlv im[)iobable. even !< i a native speakei. and it is the scoie of 
behvivTiTl and .VVV/tbai the (e ae Im is locTkmg^R)! in terms of tlieap- 
piopiTaieiuss ol die maie iialsfoi use m ilie ( lassioom (oi scoies above 
'}To fo! mdepeiideiii leading) 

Ilu (.l()/( pioteduie piov ule s an eeoiUMUical and efficient method 
bv v\hitli the teatlui eaii seU(t iiiateiials foi a class of studc'iits or for 
diagnoses ui evaluaiiiig an mehvulual students uadiiig pioblenis. It 
seems lo nu. that it unild .dso be put into the liaiids of the suideiit as a 
method l)» wliith he inigbl leain to e v aluale his ow ii leading selcTiioiis 
ind pel haps even to evaluate his own leading piogrc'ss. 

In suiiiinaiv. ilieie aie simple . easv, and effic ient piocedures vv .ich 
the i lassioom u aelie i can use m pie pai ing^jjCloailijissagcytC) be u^ 
KMtlahihlv !iieasuie. ih Se le e t^l)mit^25(rvro!ds hoiii tlie material to be 
evaluated. (LN De le te methanieallv evei> fifth woid, begiiiiiing at tiie 
iillh woiel and ^k^ppillg piopei nouns jiiel numbers should more than 
lliier oeeiu. y'.U De leu fiflv wjiiels. (I) Replace the deleted words with 
nuiabeieel blanks, (a) Sttne the passage l)> accepting only the words 
hotii the onginal le \i iX eibatim seoi mg). (()) Kvaluate scores in general 
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tau.m)nrst)l I'mstKiiioinMous In low H o). Iiisii ik HuimIm iwt ui f 1' o 
tiiul K^o). aih\ liulqu iulciH UMclmi; 5.^%). 

1 1 IS Iiopal tluii (lit ( lassHhMM Uak lu i, luuK isniuhni; tlu\m iuMht\ 
i){ tlu t\.iliKUU)iuiiUiKi will, in \i n!u Us>», laki .uK.iiiUim of lliisias\ to 
pii [i.iK. ras\ lo , aiul cas\ lost ou uaiLihiliu iiK<i^uu ami in Uoiii. 
(.1 1 suuk iits lo usi u. { tlu 111 usdl to it. ami si I up mhiu ( valuanoii 
uiU'iia tliai will woik foi tlu ii paituiiLu dass^hiu usr it. 

SAMPLE CLOZE TEST AM) LNSTRl CH ONS 

INS I lU HONS. On tlu in \t pai;i is a sanipU ol a lu w kiiul of irsi. 
Soiiu of (Ik wohIs au h It out of tlu stoi\ ami hlaiiksau put wluu the 
wouls wnc (akni out. ^OI R J()I5 WILL BE I O OTESS WIIA! 
WORD WAS EM' I Or 1 Ol EACl I HEANk ami to w liu- tlu woul in 
tlu' hiaiik. 

XoU\ I lu lasi [>aii of this siiiUiiu niii^lit uail and to wntu tlu* 
woul ou a sipaiau* niiinlK ial pira* of papn.' 

Elu lollt)w iniL^ sanipk SI utt iin s iiiav In Ir Ipful foi suukiits wlioau us- 
ini^ tills i\pi of Uculiiii^ passa,m (oi tin fiisi iiiiu\ ^ Elu aiiswiis au 
wiiiu-n iipsuk'-ilowii niuki tlu* sample sriiuiu os.) 

1 . 1 Ills a l)ook- * 

2. I likr K V I u-aiii 

3. I ill lUMhi, 1)111 I ilon'i likriaiuE. 

1. I likr ui* ( i. not caiul\. 



I hkr. 



'jiit not 



Noti. I lusi i<.nlH iloiu In tlu stiiilnitssik iitl\ ami tlu iKlisuiNsrd 
oiallv. Ask stiukiits k)i ililfi uiii aiiswns that iiiii^lu lia\i oi- 
( unal III luiinbns 2. aiul />. 

unonoicMo uiion \ur isoiup* tnu/ i ^i^ij )|.) '^^ao/ \nitj ^ s/ | 

Insiimtioiis k)i 'lu* iirxi pai^c. 

E 'liv to uai' ilu iiitiu ptissam tliioui^h om i In fou vou ho4iii lo 
WRI EE in tlu- hiaiiks. 

L' Wiiu oiil\ OXE woiilnuaih hiaiik i(-ouii<u uoiisau* possible.; 

:E You ina\ skip haul blanks and u iuiii to iluiii laiei. 

1. Sfudlmi; will not he (oiiiited. 

RKAI) EllE I X I IRE PASSAGE e\eii thoi^^h it ina\ seem dil- 
f u uh. ^ oil will Ik ahle to (ill in soiiu hianks soim w lieu on ilie 
paije. 

(). In to fill in each hiaiik. DOX' 1 I5E AERAII) lOOEESS. 
7, Ehi\ IS XO I a test, \ou will not Ik i;iaded ou what you ik). 
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SAMIMl. CLO/A\ PASSACh. I ioni "The C.istiiig .lu.n of Mis. Lccks 
jiul Mih Alcshiiu , ' l)\ Flank R. SioLkloii .iiic* adaplal ftJi KSLsUidciils 
ill PeofAe in iad and Fulton In X'iiginia Kiench Allen. 

I was on WW (loni San Fiaiu isco to Yokohama , in a vcr\ 

i^iaiUhil I. i baamc a((iuainic(l with L,aks and Mrs. Aleshinc. 

ship on whu liM iKudint; at ilu- iinif a large number of 

. most ol whom weie Among tlu-se, I noticed tlievery first 

da\ middle-agul \v(;nicn whu diffcieiit from the ordinary 

oi tourist. At liist the> ini^ht ha\e looked farmer's \vi\es who, 



foi unusual reason, had detided cross the Pacific. On 

whsination. lu)\M\ei, it seeiiied piohable thai tlie> belonged. 



\hi (amiju s of pio^pcious in stiine lit»l( KniiUiy , there, in ad- 



diuon to and sewing, the women have opportunities of 



iHtt>iiiing \\ith sonu t)f tlu waNs and in.iiiiuis of the outside world. 

pjmn:nlj)r ((.j;^ ppioA\ q^,) i5Uj>|o()? (^,~,) ua\oi (Z(>^ si.)d.)o>|(I(njs 
U6* U)r>> '>'^'"» »'^^M> inn o^ (/O .nuos (91) a>|ii (c\) ujSis 
tf () iJiJ.\i?n (t.o .)i.).N\ oAM ( ( ()) uo ({)») suH)u,)Uiv st^^Sitossud 
(H) p.)!inn {/) sita\ kj) .n\\ (c) sij^; (j.) uniuuiu (f;) uoijA\ (j;) Aha\ (i) 



Uii^.ul ( Iw/t l'i..i4 4iui< >M>kt'.tMt iMiiiti<K< u1iIm1i(% J»uMuh^tnQturirfK.\\\il*»i • 11 

)<>ii<ii UtAtit K<iHi«tiii( It Niiiiu ntii Si •uitu I'MKtdiiHN lot 1 M U III) 1^ SI Suiilitil^ liiiw^t iiiixi It.utui^ 

Icjdiiut;. \\V I.I.iuiiv f'»;!i i;k k| 

S«<|iiHft i> KioiMii stiiil<v i AlHiNki tntl ( 111 M j<>ti< N Kt|>inioii i ( l.«/i l<st Idiom I \ iSiniiriii |')7I> 
I >ln> VV OM<« |« \\ Kih K !•»;} 
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A Bibliography of ArlidcN and Papm Relcvaiii 
Ti> Clo/c TcMlm; In ESL and FL 

AiKii, I luu It itiw.mK.t Muiinhii.iii 1 1 si til I* iit^lish (.iHnjn it lu < //..SO/, 

\iuhiv)n. Itih.ith.iU Si hi iini; .1 Soii.tlilt Ki.iiiu l'hMuiuK^ im f ( .a In is lo Asm ss 
l..iiit;ii.it;c Dillru'iurs ' Shi ( Journal, II ^Dannlu'i, l{)7h. 3*')- 12. 

lultiiUiiKS U>i Mi.isitniit; Ki.idin^ (.oliipK luTiMtih .tiul Ki .id.d)ih(\ ' 



tjn^hsh iMfii^Kakfr Tau htui^. XW (lTl)i(i.ii\, 1971). 178-81, 

Btisu>. |4>M pit Ki.til.iliiltiv .tiul (lu StluUoii ol M.tuii.iU Un Adiili I.c.niioiv \ 
I'uKaliiii' " Ni A ^oIk Pui'Mo Ku .111 l oiiiin, M)7*Mininu-oi;iaplial) 

IKmin.J HuimM \ I i tii.itiM Mi .lutn itit Ki l.thM (Aiiiiiul of t.itt;li>li .tiiil Ainh.nu 
b\ KliMnili (ri.iili hihiupi.ni S^^llI(lH^ Worktmpns tn Tl.SL. Noluiiu fl Ijds 
Vn.m'lrs; riiivrisiiv of C.ihfoiiii.i. \W} 

(«nioll. lidiii H . (..JiU/iL \.iii>nS ..tiul \\ iliK. (.I.mdi.t I' An ItursUi^ntionot (.lozc lUms 
m the Mfosurement of Athirvemettt lu Foreign iMnguage. Cambridge, 
Mai^achuitlli I^it)orai(n> fur Re^carcfi in Insiruciion, Graduate School of Eiiucd- 
tion, Harvard Universiiy, 1959. 

O.uiu II.DoimIiI l\ (Jt)aitti4>p\ \l'iiKidiiu foi 1 1 Mttit; t.iit^iish l.aiii^u.it^i I'lotuuiiiX 
of I-oiiiKii Smdniis S/;m/i Mumn^raffhs. \X\\'M (Mauli. 1970). rio- 10, 

f u iiliii.ni. Miliiu il riu ( M ul ilu (Jo/I I'lotiduri fui linpro\ tut; ttu Ri .ulint; Com- 
pii lutlsioii i>f I (HI it;ii Stitili tiUot tlii ( ni\i iMi\ ol I lojtd.i, DiwertuUofi Abstnuts 
XXVfl (DtuinlKi. m\h 'Wli) 

(>r(t;iin P.iiio|><;uloN. fiiiili I nd \it K\pi ritiu iHal Applit .umn of ( Jo/t Proicdou .tsa 
Di.ign4>btK T<-st of l.istening Oimprehcnsion Among Foreign Siudmis. Dtsserta- 
Uoti Abstracts, XXVII (January, /l 967), 2231. 

(.nns< II. k.ilhlu II Ult.n IiMaiulUhx I'api mK li\nal ai ihi' 197:5 IhSOI. (.oincii- 
iion III S.iii Iii.in. I'nnio Rmt. M;i% II. I97:i (mniuomaphal) 

I fa^lvt II. Jidtn I Kif.iiitit; lUi C.Utn I'liKi'diiii foi Khglish .ts a Siioiui I .ant;ii.ii;(." 
t-Mxihsh lieaml. XXV (W'liun. 197:$). 77-82 

Ri.id Mils But Mow Dof Kinm I lux (..iir^ ' SO/.-(,/^/i\/, III (I d)iuar\. 



197")h 2. 1 

Riliiiuii; ( >ltm I isunj; iiiiil Stoiiiii: rroinluio ftii Tm w iih KSl. .Simli'iiis." 

i lissnl.iMon. Ir.uhcis (.oll(>t;c, Coliiiitbi.i CnixcrMix, April. I97:i) 

Stkdiiu* Rtadiim MaidiaK \ Xiu Appioaih, ' Uitom. Ill (Fall. 1972). I. I. 



I lolt/in.ut. Paul / him^uoiit rn/fmcm > Ivsttmi and the IndwHiuaL l-niM iMiy 

i':trk. PcnnsvKaiit.i I\-iins\l\ania Sl.ilr rmxciMtx. 1907 

ka|.l.in. RoUit B .uul }oiu <>. R \ \ (>lo/i PnKi'tlou I im (if I.isti 11111^ for CniNcrMiy 
I,i\il Suiddilsol FSI. Los \nj;(Us ('niMTMtv of Sonilicrn California. 1970. 
OnitiuoKi'iplud) 

Kia>lu n. Su plu 11 I) . /( 'iiiski. Si.inh \ 1 , .iiul |oii( (..irl .\l Rt poit <m a (.1o/< I est. * 
Ititnm. \\ <Snnum'r. 197 h 

Kl.iK . ('(oti;( R Siii.iiko.R \\ ..iiulSiohiruw.I, M The(Au^ Prtnedurr A Cimvenient 
lirnduhiUt^ lest lut Irainmx^ Matvrmls and rranslntinus. Ailiiij^toii. \ ii^ini.i, lii- 
sniiilc of Defense \n.il\Ms. 1971 

MaMiii. \ it lui R( j>i)H OH ( JoM hsts \iliiniiisuiul U) I It.n Saul* itts llulletin of the 
htiMjlish Inni^unu^e (enter, II (Maiih, 1972). 'U-')0 
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Olid, jolin \\ , |r (.lu/t h%i% Stiuiul I..iiit;u.it;( l*io(i(uiH\ <iiul WImi 1 Iu'\ 
Mr.iMiif " / tvi\;un\ie Learning, WIW * |niu\ I07.<). 105-18 

_. !)n laiKiii .1% .1 l)t MM Uii l<Mint{i n I M.im i'loluuiu^ hnt^lish 

I n iiitumr tnuhoix^, \XV t \piil. I*)7I>. Ti\ >'/ 

1.1 M i 1)1 Dittit iilu .ilulSit>iiiit;Mt lliuiUt«)i (.lo/i I i nInoI Kl]jL;li>li .(s.i St i uiul 



Boutn. I Doii.iM. Ion. 1 li.ii ISicn, .nid 'M.ixni. X'uioi \\\ "(ilo/t Tots in 



l ii.t;ii%h. 1 lull. «iiul \uiii.uiUM. N.itut «iful NiMi N.uim 1\ iftinn.iiiK ' Lansma^c 
I farmmz, XXll <JniU". 1972). 

jiul ( 4)iii<ul. (>liii%liiu \. 1 lu (Jivi l((li]]i(|r' atul l'ii!L;li>i] .i> ,i Srunid 



!.,il}^ti.it;( l*!»>^iinu\ Ijuti^uaiic I tarnim^^ XXI ^Dcuuilxi, 1971*. 18*<-*n. 



I lii.il. \i\ III \ ( Jim 1 { %t ol I n3i;li%li I*m |)<j>hu*ii> ViM)L Qiuutah, \ 



<l)(<nnl>n, •^71). W'y'lh 
.iiid K«liliiit;. \. / \nul' IN.ii"! ami ()Mi<i 1 ,<iiit;iMt;< Ski|l>/' IjitiM^mM^c 



I tatfutiM,, \\\ i jiiiu', 1971 }. 

P.uk. \lu< (. i\on l<Mim;aiul PhhuUiu 11' SI Reporter. W k\\ \\\m, \Ti^^)A-2, 

Sltiba. S4ik(\oii \ SuuU iii Ri jilaluliU Mi,isitit% — Applu <iiioii ul ttit (Jtj/t Httliii; 
U>llu lap.nKst 1 <iiii;iuiu* Jit(mn< . 7»i<(f^4a/«;/ /*>^< /i(;/<;i;>.iKm;liili Ab>tr.u l>, XX- 
vn imi*. <>7 7$ 

l.isloi \\ iKoti !, <iiul l,u . K \\ KM KuuK 1% 1 iiul ILitul tu Sut iiu (.lu/tMtlluul 
\\ oik% 111 Wiiiun Kurtjn <nhl M.(x Smt j% a Ii><»liui Koiian I,aiii;u.ij'.t' R«'fo""-" 
Komtn Mrssrniirr, 111 t!95|>, 1-') •...^"-^^w^^ I 

Nou \ .iiit>u> iiiiu |x/i lul NliutuNi't Intiii^ ijtiiuiMti^it(iiit;liuul i1k (tjiiliin. x\inut * 
4hti>( \Jiuhli.tM (ut:u Ui iitx .i(U ntitiii jtt at (lit S(au I iii\ri>MN of ('alifoiiua. Nan 
IiamiNUMpiot Diiiuthv l*iIt;Mni Danu Ivnuaiul 1 lu l,t.iriiint;(.uiU i, i( \ (a{\ 
Sia« (x>l!n;< {\h IMiilhp Muw » 
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Reading Frost: 

"Tht Road Not Taken" 

RoIktIs W. riciu h 

Islhtit .in\ piKin m Aimiuan luiialim iiuju ufti ii and niun ion 
sisiuuly nusiiUiifjiilid ilun RdIkH liust's ' Mu" Ro.ul Xol r.ikin"? 

Ag.uii .ukI .i^i;.uii llu final ihuv^dui s .uc usal nut only to dcsciihc 
I lost s \\U , but also, and niuii ^^nualK , torhaiaittii/i anyone who has 
biokm wall I on\ union and out on a loiu 1>, uuklKndtut louisc of 
a', ticjn. I oi studuits tin si uMu hulini^ liius aic p.uticul.ul) .ittKittivc, 
snuc tluy .si cm to be d suitintt .uul lutid suinnuuy of the pucni's 
niisstim *. and thus tlu' pOvin .ippc.us to rcnifortc rlu* .ittitudc that 
iiKin\ students biin^i; in pottn, tluU poctiy s nothing nioic th.in tii- 
uiilous laut^uagr pciviisih concealing plain statement. 

A I .in f ul u.idiiig of tlu poem, lio\ve\ei, will show tluit it is by no 
iiuaiis dii iiiiging .ifhi iiiatioii of indepeiideiiee it is often t.ikeii io be, 
but. Mlhei. a poun of dekat and failure. What's moie, a eaicful re.iding 
will show tli.it tlu st.iiid.iid iiiteipiet.ition e.in only be (leii\ed fioin 
piisistent iifus.il to set wh.it the words .ire .letu.illy s.iyiiig. Most 
stucKiits. like tlu II ddcis, will ignore the poem in fa\oi of tlieii own 
piic(jii(eptii;iis. and tluivfoie this poem is p.irticulaily .ipt for 
cl.Lssiooiii tt.K lung, siiKi It demoiisli.ites de.irly tlief.iulty perceptions 
that .uisi wIkii wi iieglut what might be called the fiist law in ic.idiiig 
p(jetiy: look at the words. 

When wt look «it the woids. we should note that the poem con- 
ti.ulu ts itsi If III .i I urioM.s .mil signific.iiu wav (.1 profitable cl.iss discus- 
40II might bigm by .i.skiiig students toexpl.iiii this coiiU.idictioii). The 
>speaki! tells us in the famous l.ist lines that lie took "the ro.id less 
tiavikd by, thus iinplymg that lu followed an indcpendcni, .idven- 
luious way of hfi, pi 1 haps at .some risk 01 losUo himself. E.irlier in die 
pinm, liowivii, till .spcakii tills us that the ro.ids weie appioxiiiiatdy 
tlu s.iiiii. Willi no tssuitial diffcuiue beUvecn them. One w.is "just as 
f.iir as till (Jtliir. and .is foi travel, the passing there H.id woin tliem 
iialh about tin s.imi. And both th.it moimiig eijually lay In lc.ive.s iio 
slip li.id tiodiK II bl.iik. Wire the roads different, .is in the l.istst.in/a, or 
iiiuili aliki , as III staii/as two and three? Why can't tin speaker makeup 
his inindr 

Well, lu lan, .ind has. Does he vi fa(ts<\y that lie U)ok the io.id less 
tia\ilid by! It is gi neially .issutned that he does, but the words of the 
poiiii s.iy soiiK thing latlu r diffcn lit. The speaker does say that he 
look till load less tia\eleil by. he says that he will say, in the distant 
fuluu ( Soiiuwiiiii .iges and .igis hence "j, that he took the ro.id less 
liaviled by. I lii fust two lines of die last staii/a make this distinction 
iliai, but tluy au usually ignoied .is though they did not exist. Ilie 
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spuikcr is b> uu miaiib iuukini^ back un his lift and ujiuimnung with 
piidcun his luggul iiukptiKknu. Voi unc ihmg, he i>> ncithcr.iiKiepcii- 
ihiil iu>r iKcisivc. ai> iht fiibl sian/a tells us, ht is a long tunc niakuig up 
his mind, and c\ cn w Inn he has done so, he likes to tlunk that the choice 
is not final, that he may \ct be able to return and ehoose agani ("Oh, I 
kept die fiist foi anothci da\I"). Fnithermoie, the speaker ean hardly be 
looking back on a life nearing its end, since his reference to "ages and 
ages hence'* indicates that he still has much life to live. To say this, 
ho\vc\er, laiscs several questiijns. since thespeakci 's future still lies wide 
open before him. how can he know what he will be saying near the end of 
it? What makes him so leady to offer piematiue judgments on the whole 
course of his life? What •difference" is he talking about? And why will 
he say that the roads were dissimilar, when he has clearly revealed that 
they were practically identical? 

Hack to the text. The speaker notes that when he will say that he 
look the road less tiaveled by, he will sav it "with a sigh." If he were 
asserting his individualism, he would certainly not be doing it "with a 
sigh." Foi what aie the implications of a sigh? What mood does it 
suggest? Not happiness, surely, nor eonfidcnee, noi pride, but 
something like legiet. or melancholy ,cji wistful sorrow . Contributing to 
this mood is the eiuious phrase, "Somew here ages and ages hence." Why 
woidd anyone refer to his future in just these words? The phrase 
suggests, among othei things, that the speaker sees his future as extreme- 
ly long. Weaieaci ustomed to think of life as too short, in no way extend- 
ing bevDiul us for "ages", so that if one's future can be conceived in 
leimsof "ages and ages." one must indeed be w eary of liv mg. In any case, 
iho s|x:akei can haidly be said to face tlu hiture w ith enthusiasm or eager 
anticipation, the futuie seems, rather, to be something of a burden. 

What, then, aie w e to make of this person? We know rhat he has, of 
necessity, made a choice, one "road" instead of another, and that the 
choice will ha\e significant bearing on the course of his hfc (the last 
sian/a makes clear that he is talking about more than roads). Further- 
more, w c know that he is going to tell a lie. he is going to say (he has told 
us sc;) that he took the icjad less traveled by when in fact both roads were 
abom the same, ecjually att»aotive and ecpially w orii. Why is he going to 
Hi? .\nd how does he knoiv, so scjon, that "Somewhere ages and ages 
hence" he is going to lie? 

Only reference to the details of the poem can answer these 
cjuestions, hut it is just these details that are often overlooked. When ihey 
are all before us, however, they form a consistent pattern. In the end, it 
lx.c(Mms apparent that the speakei is prepai ing his excuses, he expects to 
fail, .uul having dcjne so. he will blame his failuie on the independent 
course of his life. By c laiming to have taken the road less traveled by, he 
will be implying that lu has chcjscn to avoid the woild's ways and 
iheiefore could not be expected to succeed on the world\s terms. He will 
belying, of ccjur.sc. foi wc know that he diti rjc;/ take the road less traveled 
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b>, but lilt lie u ill piovidi » itj>pct table excuse for the failure that lie sees 
ascertain and inevitable- i.Jeed, if the lie is believed, itina> even make 
failure look like lieioisin, which is no doubt the speaker's intent. He is 
anticipating a life oi failuie and defeat, with a sigh at the end of it, no 
wonder the futuie seems so long. 

As this brief leading suggests, Fiost's poem is more intricate and 
iiioie complex than the populai uiulerstandingof it would indicate, it is 
also bitter, more subtle, iiioie perceptne, iiiore analytical, m^ie deeply 
cunceiiied with human motivation. As a subject for classroom discus- 
sion, "The Road Not Taken" has many virtues, not the leastof yvhichjs 
itsaf^pareiu simplicity . it seems so easy /r he poem is deceptive, however, 
for only the language is simple, not the technique. Still, its accessd>ilil> 
ciKeJUiages exploiation, and as it is explored, the poem reveals itself, 
piece by piece, until the pieces form a coherent whole. It is not, then, 
difficult poem so much as a demanding poem, in order to read it at all, 
wt must sit upaiul pay the closest attention to detail, if the poem is not to 
Ik lust. It is a poem that can teach us, finally, that most important of 
lessons, the necessity of taking language seriously. 
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A Development Cycle 
for a Competency 
Based English 
Curriculum, 
Grades K-12 . 

by La'SIci S. Crolub 

rhc i»ipi(l (.'Luiioiuic, soci.il, aiul pulitical ch.mgcs uf ihi da.uk' of 
ilu* 70's have pLiLul ^ii.iiiis .uul sii esses uii iU^ "trachtioiiar' clcmcnun 
and .sa(Mulai> .si lunil English cuiiitulum and Lnghsh tcachus. In <ni 
a,m' wliii hilcmaiuls .id\.inn.d lilcni) skills fur suuiv.il uf even the luii k 
ill IV 1 1 »iiul tlu fiiunan, Iinglish teachers in the schuulsaii attouutable 
lu muic than tlu piiiuipal of their sehwl and the distiiet supeiinten- 
ilenl. I caehcis of Knglisli an ii sponsible to tilt Aineiiean society whieh 
lines them todiiajiib. 1 his puseiu Aineiieanl society has expectations 
iui the n|xiMning,m lu ration. Rcbponsible adult ineiubeisof this society 
ixpect the entuuig iiuinbeis of the society to b^e competent in c.irrying 
out uriaincari fully di hncatcil ic/uu lors and thyughts which satisfy the 
neecL ol the society. I luiev eloping an English cuiriculum, K-12, for the 
ihiklien and adoksceitts of .in Aineiic.in hchool district, teacheis must 
consider, tl) thcii ai coniitability to the society which hiies them and 
pay.s their sa lanes, (2) the nteds and expectations of Uiat socjety , (3; the 
utn fully slated Liiglish and leading objectives defter nnned to mci;t these 
iueds» aiul ( 1) the attaiiuil and developing English and leading com 
peleniitsof tlu i hdduii and studuits .is tlu y progress from level to level 
in ail instructional system. 

hi the tlevelopiiunt of an iiistuu tioiial system in English and 
uaduig, eknuiit.iiv ami seiondaiy, the eliiklieii and students aie 
|Ki(M\til .IS ik\ I loping buiiiaiis \\itli an exp.r^iidiiig lepetciire of 
u>giiuu( and beliavioial .bili^ies and experiences. Ellis stance is the 
fiisthuak fioni tiaihtiuu siiut di vi lopiiuiitally, children and sludeiits 
piogiess from k\d to k \d of loiiipitciuy, rather Uiaii from gi.ide to 
giadc. Levels, lunvevei, eiucimpass guides as k)lkn\U: 



Level I. 


Criades K.2. 


Ages 5-7 


Eg(Weiitrit cognitive 


Level IL 


(rrades ,^1. 


Ages 8-9 


aiuf beliaviora 1 abi li ty 


Level III, 


(riacles 5-6, 


Ages 10-11 


Cx)nc!c ic c ogn i I i ve a ncl 


Level IV. 


(riades 7-8» 


Ages 1 2-1:3 


belu^vioral ability 


Level V. 


Guides 9-10, 


Ages 11-15 


Abstract cognitive and 


Level 


(blades Ild2 


Ages h).l7 


behavioral ability 
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At each level, the iDiilcnl a.ca.s iiicliKk*. [l) lihicniiig, (2) speaking, 
(3) reading, {{) writing, (5) language, (6) liieiaiurc, and (7) media. Cer- 
iainl>, nut all uf the aiiiiculum tit under the format uf a competency 
based English tuiiiculum, but an attempt at a tompetenc> based 
Knuii^h LUiiuuluin attach kvel leads ttjbettei uijdeistandingof \va>sof 
assuring students' eompeteiu.e m Knglish and reading peiformance. 
The developmental stages (Figuie \) to be encountered ovei a period of 
two oi more >eais include, (l) needs assessment, (2) selection and 
description of concepts and skills to be developed at each level, (3) 
development of toncepi and skill objectives, (Ij development of test 
Items foi concept and skill objectives, (5j development of materials and 
activities for teaching objectives, (6j development of individualized, 
learning activity packets which include (a) objectives, (b) pre-test, (c) 
learning activities for each objective, and [d) post-test, (7)-fonTiative 
evaluation and rev ision of Learning Activity Packets for maximum stu- 
dent attainment of objectives. development of the sequence and scope 
of a Coinpetenc> Based English Curriculum at LevelsJ, II, III, IV, V, and 
VI. Each of these developmental stages lequires careful exp'anationand 
deliberation. 

Seeds Assessment — The needs assessment is the first and most 
critical stage in the development of a competency based English 
cuiriculum, K 12. The needs assessment relies on input information 
fioin the following sources. (Ij knowledge of student^' future needs in 
school, societ). and culture, (2; knowledge avai^ble from the psy- 
chology and sociology of learning, (3; know ledge/toin (a) research, (b) 
curriculum theor> , and (c) teachers of English and communication. The 
follow ing is a sample of a few English and reading needs selected from a 
larger list: 

Level I, Grades K-2: The child needs to: 

1. Follow simple auditory directions. 

2. Develop vocabulary. / 

3. Discriminate sounds of vc^vvels and consonants. 

I. Recite and recogni/e th^ alphabet, capital and small letters, 
printed and cursive. / 

5. Associate sounds witlyietter clusters. 

6. Write from left to right and top to bottom. 

7. Foim printed and ciirsive letters and numbers. 

8. Recogni/c* -s as plural or person sign, 

9. Write declaiative and question sentences. 

10, Read words and sentences written for Level I with a 70-80% level 
of compiehensioiK (This need appears for each Level.) 

Level II f Cirades 3-4: The child needs to: 

1. Demonstrate a 70% perfoimaiue level on objectives stated for 
preceding level (Level I). 

2. Discuss infcjrmally with his classmates, 

3. Paraphrase oi answer c]uestions on oral reports and presen- 
tations. 
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Wfiic seiucijcc5>, i)im|)k* paragraphs, and letters. 

5. Spell ami use words found in reading materials. 

6. Recognize dialects of people studied in U.S.A. geography 
lessons. 

7. Retell a stoiy with u logical bequencc of events. 

8. Read poetry and folk tales. 

9. Experience etiinic literature. 

10. Write a paraphrase of a pre-read story. 

Level III, Grades 5-6: The student needs to: ; 

1. Demonstrate a 10% performance level on objectives stated foi 
. preceding level'(Level U). 

2. Paiticipate and communicate orally in situations suJi as book 
reports, discussions, group reports, giving diiections, and 

/ vocabulary study. 

3. Use embedding transformations to produce well formed 
sentences. 

*l. GaUieriand logically organize information. 

5. Recoiint in oral or written discourse folk tales, fables, and 
niythii. 

6. Use t^ie dictionary. 

7. Use tine encyclopedia for information gathering. 

8. Use prefixes, suffixes, and root words to expand vocabulary. 

9. Recognize a sentence as consisung of a noun phrase and a verb 
phrase (S — NP + VP) or a subject and a predicate. 

10. Write sentences in connected discourse to form paragraphs. 

Level IV, Grade 7-8: The student needs to: 

1. Demonstrate a 70% performance level on objectives stated for 
preceding level (Level III). 

2. Write and speak nouns, pronouns, verbs, objectives, and 
adverbs with their proper word forms and markers. 

3. Use prepositions and prepositional phrases to add content to 
sentences. 

-I. Write subject-verb agreements. 

5. Compound and embed sentences to form c\.mpound and com 
plex sentences. 

6. Spell words using rules of English orUiography. 

7. Write creatively on topics of interest to students. 

8. Speak so that ideas are accurately and logically presented. 

9. Select the central idea of written or oral discourse. 

10. Separate factual from judgmental statements. 

Level V, Grades 9-10: The student needs .to: 

1. Demonstrate a 70% performance leC^l on objectives stated for 
preceding level (Level IV). ^ 

2. Spell a list of useful words at a 70% performance level. 

3. Read materials written at this level at a 70-^0% tompiehension 



level. 
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I. Wiilc \vii\icn cuiiuiuinic.uiuii which dciivcs.il k.ist .i (.giack- 

fioiii ihice experienced and peer t^iaders. 
T). Speak an oial coiiimuiiitalioii uhieh deiivts at leasLa C giade 

froui ihiee experienced and peer giadeis. 

Read ihiee novels fioin the Auuncan, the Biitish, and othei 

ethnic experiences. 

7. Ideniif) piopoganda, enleiiainincnt, and education featiucsof 
mass media (pie.ss, TV, cinema, etc.), 

8. Respond to independent leading. 

9. Read caieer oriented discourse. 

10. Denionsliate efficienc\ in basic toiiHiuuiieations i>ituaUons 
such as letter uritiug! telephone coiuer.sation, information 
gathering, and vocahulaiy development. 

Level VI, Grades 1 1-12: I'he students need to: 
I. Demonstrate a 70?o peiforiftancc level on objectives stated foi 

pieceding level (Level V). ^ 
2.. Selectan English cuiiiculum appiopiiatc to his life goal orien- 
tation, e.g., academic, vocational-technical, business, and 
geneial. 

3. Peifoim tiansfoimation.s, deletions and embcddings in 

generating written sentences. 
'1. Analyze a written text to determine its content. 
3. Deinonstiate a TO^o compiehcnsion of vocabulau words fioni a 

useful vocabulary building list. 

6. Identify themes in literatuie. 

7. Respond to works fiom American, British, and ethnic 
liteiature. 

8. Deinonstiate a knowledge of themes in liteiatuie. 

9. Write in the forms of the journal and the essay. 

10. Participate in huge and small gioup discussions. 

1 1. Read a passage fiom literature for oial inteipretation. 

12. Participate as a member of a debate team and or a fV)iuin. 

13. Assume the lole of a ch.nacter hum fiction or fiom leal life. 
M. Recoid and ciitically inteipret a video tape. 

15. Trace themes in literatuie which parallel histoiy, 
10. Demonstrate cultural growth and understanding. 
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DeterminiHi^and Dei eAopmg Objettum—X clo.se look at needs at 
each level will indicate llie> contain elements of icpetition, ex- 
cessive iiess, and tiiv i.ilit\. NcJt all of the needs w ill be developed into ob- 
jectives. Some needs might not be suited to the level, the) might not lend 
themselves to the t>pc of cognitive and skill instiuction being discu.ssed 
heie, oi the) might be tiivial. Teatlieis .md consultants will need to 
lliiasli um and tosoitour a sec|ueiic c of needs appiopiiate to each lev el of 
instiuction. and hoin this point, develop sets of objectives aiound con- 
cepts or themes. 
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Objctiucs m a coiupclcncy based English curriculum arc classified 
astognilivc and skill objectives, remembering that the compeiency bas- 
ed poi lion of the ciu i iculum is, at the most, only about two thirds of the 
total cun iculum. i he affective objectives are the remaining third of the 
ciunculuni— snpeiv:sed, through small group activity, b> the teacher. 
Cognitive objectives include (a) concepts, (b) instructional processes, 
and {Q evaluative piocesses. Behavioral (skill) objectives include (a) 
behavioral skills and (b) cognitive manipulations. :'l//ec/iVe' objectives 
include (a) auitudinal changes, (b) opinions expressed, and (c) 
motivational changes. 

Developing Test Items for Objectives— -TUq add test of a good ob- 
jective IS to be able to write uest items for that objective before the learn- 
ing activities aie developed. A set of such test items can also be used as a 
pre-tesi to determine w hether or not students already know the material. 
If such is the case, then the objective is not useful for that level. For the 
purpose of individualized instruction, the multiple choice type of 
questions best suits the purpose. Here is a set of Level V, high school 
concept and skill objectives and their accompanying test items: 

/ 

LISTENING— Intonation 

Concept objectives: - 

Ihe students will be able to identify the three fcaturesof intonation. 

Sample test item: 

That quality of speech, intonation, includes all except which of the 
following features: 

a. alliteration 

b. stress 

c. pitch 

d. juncture ^ 



LITERATURE—- Realism, Expressionism 

Skill pbjective: ^1 

Describe how the presence of the Stage Manager in "Our Town" is 
consistent with the character elements of the expressionistic mode of 
drama. 

Sample test item: 

The difference in the way the author, T. Wilder, delineates the Stage 
Manager in "Our Town" from the other characters is: 

a. by what they say about themselves to other characters 

b. by what the author says about the character 

c. by what the character* says to the audience 

d. by what the other characters say about the character 
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LANGUAGE 



Concept objective: 

The btudcutb will bcablctoictugni/t stiucnccb utili/.ingcumin.ib to 
set off words in diicct address. 

Sampie test item: 

In \v hicli sentence is die speaker being derogatory to the person he is 
addressing? 

a. Dope, Ilarry, and George will be upset. 

b. Dope, Harry and George will be upset. 

c. Dope, Harry, and George will be upset. 



Concept objective: 

The students u ill be .ibic to arrange the stages of group discussion 
in solving a piohleni. 

Sample test item: 

Qf the following steps of group discussion use numbers 1 througli 
J, one signify ing the fir^t step, and 5 die finaUtep, to show the workable 
pattern to solve a problem. 

formulate and consider possible solutions 

state the problem in exact terms 

arialy/.e data 

select the best solution 

collect pcriincnt data 

WRITING— Thematic and Expository Writing 

Skill objective Ul 

The students will be able to order an argumentative paragniph. 

Sample test item: 

The following sentences compose a complete paragraph. In the 
space preceding each line mark each line in numerical order jl, 2,3, i) 
witli line I bein^ the introductory sentence. 

iVIany Europeans think we do not. 

Tlie ordinary American reads cheap literature, mostly from 

magazines and condensed books— goes not to plays birt to 
movies, usually solely for die sake of ''seeing a sl.iow»" and 
' listens to either "juke box** music of simple strains to folk 
music. 

hi America, we have a high standard of living and abundant 

opportunity, but do we have an appreciation of literature? 

Relatively few Americans read great books, sec great plays or 

listen to gre^at music. 



Figure 2 illustrates a strategy for obtaining the ..vcds and objectives 
for A COMPE'I ENCY BASED ENGLISH CURRICULUM, K.12. 



SPEAKING — Group Discussion 
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Developing ami i.KiiliuUing Instrmiu*nal Materials — Once the ob- 
jectives <iikI the test iteiiib «iie w i itteii, the de\ elopuien t and e\ <iliuitioii uf 
then iiibtiiictioiial iiKUeii*db will be e*iS> for moi>[ teachers. E\emplor> 
iiibtrnctional materials are a\ailable in an abundance of pre written text 
iiuitciials. No luiii^ei w dl one single "clavs set" of texts be needed. Some 
texts nnglit piuve nsadeijiiate to nie( t the objectives of this curriculum. 
Before tlu finished nuln idu»di/ed Learning Acti\ it) Packets (LAP) are 
assembled foi niclusion in the eompleted cuiricnlum at any one level, 
the\ .^lundd be evaluated h) at least three teachers on three different 
gioups of ehildien oi students. Phis type of foimative evaluation will 
assure a usable piodtict. 

J Com pelt my Based English Curriculum Guide — A Competency 
Based English Cuii icuhnn Guide vv dl take from tvvo to three years for a 
dedicated team of teacheis in a district to develop. They will need con- 
st*mt assistance and encouragemeiu from their »ulministration and one 
i>i moie LOiisultaiits and specialists in English anc|.readiiig curriculum. 
Phe following aie the components of such a curriculum guide: 



1. Thcie will be one guide for each of die following levels: 

Level I Grades K-2 

Level 11, Giades 3-1 

Level III, Giades 5-6 

Level IV, Grades 7-8 

Level V, Grades 9-10 

Level VI, Giades 1M2 

2. There vvill an Explanatory Statement at the beginning of each 
guide level which contains the following information: 

a. A definition and lationale for teaching the Erjglish, reading, 



District. 

(1) Vocational needs 

(2) Academic needs 

(3) Social and cultural needs. 

c. .Some bioad goals for the expected student performance upon 
leaving the district. What vvould be a minimal performance 
level expected of an aveiage, literate, high school educated 

student from the School District (exit behavior 

described in broad terms)? 

d. A desciiption of a Competency Based English and Com- 
munications Curriculum. 

J) It piov ides foi indiv idual language abilities and develop- 
ment for students. 

(2) It provides for individual vocational, academic, and 
ciiiuiral needs and inteiests of students. 





b. The diverse and basic needs of students in tiie 



Sciiool 
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(3) It iissuifs thilt specific skills »uul knowledge »iic ()I)i»uiic(l 
b> each individual as he piogiesses fioin level to Icyel. 

(4) It pro\ ides iiuli\ idiiali/ed learning aciiv iiies for each stu- 
. " den I. . 

(5) It piovides an eniei and an exit lest at each level toassure 
the teacheis and students that at least 70?o inasiciy level at 
each level. 

(6) It piovides foi diagnosis so that students can ie\ iew skills 
and knowledge of niatei iais at a lowci lev el if mastery has 
not been at a satisfactoiy level. 

(7) It pi o\ ides times and facilitic,s for teachei and student to 
woik creatively in an open-clas.sroom setting on useful 
and thoughtful communications tasks in the aica of 
language, literature, and composition involving listen- 
ing, speaking, reading, and writing skills. 

:i The bod> of each guide at a le\el will be unique and will contain 
the following: 

a. A stateiueut of specific English, reading, ami com- 
munications needs of students at the grade and age Iciel, 
These needs should leflect the average language development 
of children and students at the particular level. 

b. A statement of broad objectives for each level. These should be 
selectiveand represent skillsas uell as concepts. They should 
cover language, literature, and composition and includccom- 
munication skills of listening, speaking, reading, waiting, 
and media. 

c. A sample entrance and exit test for each level. 

(1) Both the cntiance and exit test should be the same except 
for slight changes in the items. They area form A and B of 
the same test. 

(2) The items are obtained from the specific ol)jective. 

(I. The sample objective, activity, test item for. each level, Thi.s 
^ section should grow and change from year to year. 

e. Samples of individualized Learning Activity Packets for each 
level. This section should grow and change from >eai to > ear. 

f. Suggested outline for mini-courses, open-classroom ac- 
tivities, and creative learning actwitie^. This section would 
include such items as activities for gioups. learning centers, 
units, and mini-courses and can suggest audio-visual, 
literature, and writing activities. This section should grow 

' and cliange from year to year. 

g. Bibliography of teacher references, student textbooks, 
literature, and audio-visual materials. This .section should 
grow and change from year to year. 
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DEVELOPMENTALSTAGESOF A COMPETENCY BASED ENGLISH 
AND COMMUNICATIONS CURRICULUM, GRADES K-12 



Stage 1 



Siage2 



Stage 3 



Stage ^1 



Stage 5 



Stage 6 



Needs Assessment 



Determine Concepts and 


Skills 









Develop Concept and 
Skill Objectives 



Develop Test Items for Ob- 
jectives 

5 



Develop Activities for Teach- 
ing Objectives 



Develop Individualized and 
Systematic Learning Activity 

^P.ickeis which Include a Set 

^oKQbjeciives 



One Month 



One Month 



Two Months 



Two Months 



Two Months 



Four Months 



Stage 7 



Stage 8 



Teach, ^Evaluate, and Revise 
Learning "^y^ciiviiy Packets for 
Student Attainment of Objec- 



tives 



Develop the Seqhence and 
Scope of^a Compeietifey Based 
English/Communicaiiom. Cur- 
riculum, Levels I-VI \ 



Four Months 



Three Months 
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Figure 2 

A Strategy for Obtaining the Needs and Objectives for a Competency 
Based English Curriculum^ Grades K-12 



Stages 1^ 2^ 3^ and 4 
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STEP II 

/ 

PRELIMINARY STATEMENT OF OBJECTIVES FOR AN ORAL AND WRITTEN LANGLAC.E PR(K.RAM 
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STEP III 



ASSESSMENT OF STUDENTS LEVELS OF ATTAINMENT OF OBJECTIVES,STEP II 



I illl llliiit MUm ul (OIKCrpU 




Z UUiMdti.iiMti (4 nijicrijih 










.Hul Ki'itH k\tU 111 uhuh 




j(x4t\('> liable fur dtvc^s* ^ 


.iittmpud iitfiii Su)t li 




tirtu ( \n\ ,iii<t Iroiii 
Sup M iU( .uuiKiblc and op- * 
fiinjll> ijugbi 




iiMiii pMi)x>s<-)at)d runiOuc 
inig .i%s<-\Mikiu iiisiiuincnU. 



STEP IV 

EVALUATION OF CONCEPTS AND OBJECTIVtS, STEP II 
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/ STEP V 

•STATEMENT OF NEEDS AND OBJECTIVES FOR ORAL AND WRITTEN LAN(.l A(.E PRCK.RAM 
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Improvisation and the 
Teaching of English 



by 

Patrick L. Courts 



When I fini.shal piqxniiig iii> talk foi toda>, 1 fc.ilimi that I luid 
\ iolataj just about t\ci> luit wt la> out foi the pioduction of di.scouisc 
wlun uc ait itlhng .stiKkiiti> how to piodutc speeches oi papcis oi 
whaluti. I ui Lxaiupk, 1 didn't Ik i;iu u ith aiunuhiic, I didn't define iu> 
topic oi \\i iit down a stateiutnt of theinc, 1 c\en foi got to biinga pen oi 
sheet of papLi lo tliCLpl.ice 1 was .sitting. On top of all the.scthings I didn't 
do, sins of omission, so to speak, I also did some b.id things bee.mse I \v<is 
silling iua\u\ coinfoi labk chaii and listening to m> collection of Bob 
DyJan ictoids. At the same time, I was thinking o\ei the conferences I'xe 
been lo this past \eai, the talks V\t' heard, the teachers r\c talked lo, and 
ilie siudent.s I've been leaching. 

While I was in\ohed in this somew hat muddled^ihinking prcKX'SS, I 
ingan to fall in and out of a da> dream I ha\e e\ci> once in ,i while, 
w hcicin 1 am at a pait\ sometime in thefutme, and the thenicof thep.n- 
l\ is tht l%0*s. ^People aie diessed in mixtuies of.arni> fatigues fiom 
aiiiu sill plus stoiis and old, loose fitting elotlung fioni sah ation <iim> 
stouts, riu pii/c foi the best costume is the soundtiaek fiom themo\ie 
\Voo(Lst(Hk, and othei pii/es are being gi\eii for the most .mtheniic 
piottst signs. Most of the people aie milling aiound "doing their own 
thing. ' though some people are made up in blackface and pretending 
lhe> au 'sitting m" o\e! near the kitchen. E\er>one is having <i good 
lime listening to e.iilv Beatles lecoids. I)>lan, and the Jefferson Air- 
plane, and tliccomcisations consist maial) of people leminiscing.ibout 
ihc Ci\il Rights Men cment, the 1968 Demociatic Con\ ention, and how 
Ma\oi I^altv was the last of thegicat, old politicians. The con\eisations 
also abound with phiases like "ripping smff off," "offing pigs," <md 
"blowing people '.s nnnds." K\ei)one, howe\ei, is c.ueful to a\oid 
SCI ions discussions of things like the Watts rioLs, the iin.ision of Cam- 
bodia, the ensuing deaths at Kent State, and the assassinations of the 
Kennedys and Mai tin Luther King. After all, it is a party. 

Anywav. m the midst of this soinewh.u nightmarish \ ision and, <u 
llie same time, ti>iiig to think of e\actl> what I was going to talk about 
loda>, two lines fiom Bob I^>lan's fai laiigiiig rcpei toirekept imposing 
tlu msehcs on ni) now tlioioughl> o\ eiw lought consciousness. (1 wai> 
beginning think that inaybt I should ha\e begun with an outline*) 
The fiist liiu that popped into m> he*id is fiom a D> Ian song c.illed " The 
Ballad of a I hin Man." It is a song about a man who is trapped in a 
woild lu no Kiiigei uiidei stands, lie sees the feiment around him, the 
n)iifusion, and tht aiguiiients, but he cannot oi will not understand, h 
almost scans as though he has been taught to igiioicthe realities around 
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him, taught tiuu Ul uxuim ilM) *iffctt tlic^c ic*ihticj)an>\\a\,»uui that 
he has kaiiicd his lesson ucll. The hue I'm thmkmg of foims a kind of 
choius in the song, and it is, "Something is happenin*^, heie, but >ou 
don*i know what it is, do you, Mi. Jones?" hi shoit, Mi. Jones would 
(|uiie likely beat a party like the" one I just desciibed. 

, The othei line that popped into m> liea(I,eonies hoina song titled 
*\Sublenanean I lomesick Blues", it>a>squitemattei of faetl> that **You 
don'lneexla weathciman to know which wa> the wind blows. "Some of 
>ou mav know that this is tiie line honi w Inch the Weaiheimen. a ladieal 
political group of the OO's, eiiose theii name. But the line is much moie 
important than this bit of tiivia suggests because it implies that 
although^^liings sometimes seem \ei> complex and confused, so much 
so in fact thai wcaie lendcied impotent and unable to filtei outacouise 
of peisonal action, thai e\ en amidst this confusion, things aie often a lot 
.clearei than the> sometimes seem. It really isn*i very difficult to figuie 
onV which way, the wind is blowing. 

Of coinse. when Dylan wrote these lines he did not ha\e education 
ingeneialoi English leaching in particular un his mind, but die lines do 
apply nicely to us and om piofcssion. We live in a time of ferment *uul 
coniro\eisy, and as piofessional educators we are bombarded with 
jaigon-laden arguments for and against beha\ioral objecti\es, 
accountability, pel formance based cei tification, specification of teacher 
competencies, impro\ed inteiface, humanistic cuiiicula, flexible in- 
siiuctional systems, sUmdardi/ed tests for language aits, ad nauseam. 
Ileic in New Voik. the situation is being further confined by the ap- 
pointment of an Inspectoi Gcneial of Educ'.ation whose job it is to make 
education in this state more efficient, biobably by implementing 
systems approaches to the teaching of English based on the behav loral 
systems used by the Pentagon in the sixties to design planes that would 
not fly and later discaided by thePentagon because of the excessive cost 
and waste incurred by the system. 

Clearly, something is happening here, and it would take someone 
with Mr. Jones*s blinders to avoid seeing what it is. We do not need a 
wcathennan to know that most of the wind that's been blowing in 
education lately has been concerned, not with what we actually do in our 
classrooms, not w ith what a student shoukllcarn in an English class, not 
with theacti\ ities that makeup this thing wectdl English, but with how 
to measure what wedo, how to account for ii,how toniakeit lesj expen- 
sive. In short, we ha\e been looking at things backw ards by a\oidingUie 
\ery difficult cjuestions of what and how to teach, by making the very 
dangerous assumption thai learning is measurable and cjuantifiable, 
and by operating on that assumption in face of a grow ingbody of infor- 
mation that strongly suggests that almost all IQ tests, reading tests, and 
writing tests aie severely limited and discriminatory in lenns of race, 
culture, class, dialect, and geographic locale. 

We don* I need a vv cathernian to know that the teaching of grammar 
(when that meaiis to study about language rather than to work with die 
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varieties uf language we and our sludciils produce) docs not change a 
peison's competence in that language, he will not talk "better," read 
"better," or write "better" as a result of the twelve years of grammar he 
studies in elementary and high school any more tht.i Uiat fieshman 
com|X)sition course based on grammar and usage will Cii uge his life. 
And we don't need a wcatlierinan to know that many of our students are 
unable to read and even more don't much like to read because we have 
cut them off from the topic> and books that have immediate bearing on 
their lives. Instead, wejiave rigidly enforced a traditional curriculum 
emphasi/.ing4he transmission of our cultural heritage through the study 
of great books and the writing of literary criticism about these great 
books. At its best, such a system produces literary critics who will go on 
and do the same thing to their students, at its worst, it produces people 
who hate literature and who think that they must have an English 
teacher present before they could ever decipher the "hidden" meanings 
of a poem. ^ . , - 

^ But I ha\e been Negative enough, and it is only fair to say that you 
^ don't need a weatherman to know that the winds of change have blown 
ysome fresh air in to the teaching of Engl ish. Furthermore, it is about time 
that I heeded my own call and started talking, specifically, aboutsome of 
tlie concrete things I think teachers should be doing in their English 
^-.Qla^sfooms. f 

And so, I finally come to the topic that was listed for my presenta- 
tion. Improvisation and the Teaching of English. I chose this topic 
because I believe that; improvisation can profitably serve as one of the 
central activities of the English class— an activity of major importance 
to the teaching of^writing, literature, talking, and human ex p>erie nee in 
general. «^ 

I suppose the first order of business, then, is for me to define what I 
mean by improvisation and to offer some cpncrete examples of how im- 
provisations can operate in English cIassr9oms. Improvisation can in- 
volve students in the relatively simple but fun activity of pantomiming 
words likcanger, love, pride, fear, cil., while the rest of the class or group 
tries to guess what it is the actor is trying to convey. Or, the pantomime 
can be made slightly more complex by asking students to act within the 
context of comniun situations, a man has lost his last coin in a cigarette 
macliine and has still iiot gotten his cigarettes; a person taking a drink 
from a water fountain gets drenched bccauseithe water pressure is too 
high, a fisherman loses the "big" one. The situations themselves are fun 
and easy to create, and Tve yet to find students who would not par- 
ticipate happily in these kinds of activities. Aside from the fact that 
students generally enjoy doing these pantominies and trying to guess 
what word or situation is being pantomimed, this activity also provides 
a concrete base for a variety of writing activities. At the most basic level, 
students can write short pieces describing the situation that was pan- 
tomined, or they.might wish to write about a timetliey had trouble with 
a Coke machine or the time they lost the *'big" one. They might wish to 
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write a criticism of the person who perfoimed Uie pantomime, 
suggesting actions he should have employed to better convey his word or 
situation. Other students may wish-to go so far as to write a short story 
about the situation they saw pantomimed, or, a characiei sketch of a per- 
son they know who is atigry, in love, prideful, etc. In my own mind, the 
most important thing here is not the kind of composition they write, but 
that they have a concrete c^xperience to base their writing on. 

.\t a slightly more complex level, students can improvise situations 
of their own devising in which several people uke part and in which 
they may or may not use words, depending on their own wishes. For ex- 
ample, they might do a take-off on the man who lost his money in the 
cigarette machine Just when he is at his angriest and kicking and shak- 
ing the machine the hardest, the store owner or hotel clerk might ap- 
proach him and politely (or angrily) request that he immediately stop 
wrecking the machine. The possibilities of such a. scene should be ob- 
vious, as the t\\o*men begin to argue hotly, a policeman comes along, the 
first man's wife or child might come along, and for that matter, a Mar- 
tian njight^t-ome along. All that really matters is that the people con- 
tinue to interact in terms of the initial conflict, possibly taking sides for 
and against the machine. 

Agaiji, such an activity suggests a wide variety of writing activities, 
some students might ^e enterprising enough to write a one-act play 
based oi] the improvisation, a play they might later perforni and 
possibly even videotape. Students involved in this kind of follow-up ac- 
tivity could also work out^costuming, background music, and even an 
integrated slide presentation, if they wished to pursue the idea to its 
natural end. Other students might only wish to write character/sketches 
of the people in the iniprovisation, or expository papers describing ex- 
actly what happened in the improvisation, possibly working from the 
journalist's objective point of view. And still others might write per- 
suasive essays taking the part of one side or another (for oi against the 
machine) and trying to convince the reader of their point of view. Ideal- 
ly, of course, students will create their own conflict situations, and with 
a few simple directions from the teacher, they will have littledifficulty in 
creating, planning, and when they wish, performing their im- 
provisations. 

In preparing students for th.ese kinds of improvisations, the teacher 
can employ a variety of strategies, but I prefer to break the class into 
groups^ of four or five students and to ask them to think about the kinds 
of conflicts they see everyday or in v/hich they, themselves, are sometimes 
involvccL A few examples will help them here, studentsmight improvise 
a situation, in which a son or daughter brings home the ''undesirable" 
person he or she h.is been dating against his parents wishes. Such a situa- 
tion might resolve itself when the parents find out that the undesirable 
is a nice person after all, or when everyone becomes so angry that the two 
young people leave the house. Other conflict situations thatare\elative- 
ly familiar to many of our students are those that deal with racial, ethnic, 
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oi icligiuus biab^ those that deal u itli tht gciiciatiou gap, and those that 
focus on tontio\cisial topics hkc woiucu's hbciatiou, ecology, stiidciit 
activism, etc. . ' 

M aiu latc, r\c usiull> found that as long as the students ha\ea 
tlcai idea of the kinds of conflicts thc> might inipiovisc, tlie> have little 
difficult) tieating then own. The onl> diicction I generall> gi\e them 
when tlie> aie planning these kindsof inipio\ isatioiisis that the> shoidd 
carefidh plan an endmg foi theii iniprov isation. This \v ill help them to 
a\oiil the deadly impio\ isations which seem to drone on foie\ei, doing 
the^saine things o\ci ami o\er again, because no one in\ol\ed in tl.^ • 
pro\ isation knows how to get out of it. Another important g » 
lion loconsidcr is that the pcifoimanccuf these impro\ isatioi. b. 
the least important and necessai> pait. h is the creating and pi<i...iing 
pun ess that slum Id be emphasized becaUsse it is there that the students aie 
acti\el> engagCil in ci eating I i tei a tuie and struggling with the problems 
of oigani/ation. chaiacteii/ation, stereotyping, plot, theme, etc. 

In in\ own experiments w ith impun isaticui, I ha\e foimd that most 
students cnjo> the planning stage, but some of them become terrified b> 
the acting-out stage. At the same time, theie are always a few who aie 
happ> and willnig to peifoini their impro\ isations,. and these few 
gioups6Uppl> us with all we need foi laige group discussions. ^Vitcl as far 
as wiiting activities aie concerned, students who have not performed 
ihcii iinpiov isations can still writeaboiU the ones tlie> see other students 
peifoim, tliev can write about the improvisation the> planned in their 
gioup, OI, tlu> might want to explain wh> it \, die> are afraid to perform 
their own improvisation. Some ma> want to script their impiov isation 
and see if aiiolhei group will perfoini it. The point is that we don't have 
to torture anyone with improvisations. , ^ 

Earlier in this discussion, I said tl»at I viewed improvisation as tiif 
central activit> of the English cla.ss, out of which a variet> of other ac* 
t IV i ties should giow. So fa i, it may seem that I have said a lot about im- 
piov isation and wilting, but very little, if anything, about literature. 
Quite the contrai^, though. I think I have said a great deal about 
literatuic foi the nnpiov isations themselves are a diamatic form of 
literatuie and no less valuable bec^ause they have been created by 
students. On the other hand, \ve all are interested in teaching 
profes.sional liteiatuu , and I think that impiov isations can prov idea lot 
of help heic also. 

If, when we teach literatuie, it is our desire to help our students dis- 
cover their own and otheis' hum.mness, and if we sec literature as the 
nian's artistic cxpiession of the human condition, of the consciousness 
cfnd thesulKon.scious. as the artistic exp<c'ssioii oftlio.se pi i\ ate moments 
vve all have but nevei ai ticidate. as the catalogueof events w hich make us 
a part of tliatgioup wc call huifjanity — if we see literature in these terms, 
then impiov isatton has a natural relationship to the study of liteiature. 
The themes, the conflicts, the funny little incidents, and the human in 
teraction.s which aie at the center of dramatic improvisations are also at 
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tlic cciiici uf liiLitUuic. And wluil bciia \vay lu begin lu experience ilic 
luuiiamiGSii,^ liicMiuic than lu participate in sume concrete icpresen- 
tatiuiib of tluTfhwicis, emotions, and conflicts presented by the writer. 

Before I gu any f ui ther w iih this point, 1 should be clearer about the 
kinds of impro\ isatiorjis I see students doing in preparation for or 
\x>t*oe to litcraiy works. 1^ is icommon mistake toaskstudents to per- 
>:ni a scene taken straight out of a novel or dramatic poem, and the 
reason it is a mistake is that it limits the students too much. Instead of ex- 
ploi ing the nalui e of the emotions, the conflicts, and or the interactions 
with which the woik deals, they are put in the unpleasant position of 
copy ing oi re-proilucin*, vv hat has already been done. I give this caution 
only because I\e seen so many students and teachers suffer througli 
these moments, all in the best of faith. 1 suggest that it is more 
worthwhile for the students to create their own improvisations based on 
ilie kinds of conflicts represented in a novel, or on the kinds of human 
lelationships, oi kinds of situations. For example, if the novel is Grapes 
of Wrath, students might work out improv isaiions dealing with poverty, 
a family breaking up, or the hardships of farm life or of being niigr.mt 
woikei*>. rhis kind of aeiiv ity is valuable because it gives the students an 
opportunity !o exploie their own ideas and feelings about the themes 
and topics presented in the work of literature, and the improv isalional 
experience offeis a concrete base for comparisons between the w.iy the 
students see things and theway the writer presents things. The literature 
lias bearing on the lives and experiences of the students because the 
eltissroom activ ities and tipproaehes to the liier*uure are focused on the 
Students and their icieas. 

Improv isations offer die students a chance to bring thereal ev-cnts of 
their lives into the classroom for discussion, analysis, comparison, and 
to serve as beginning points for wiiting and the study of literature. An 
emphasis on impiov isation in the classroom puts English back into a 
living context and removes it from the sterile, dusty place it so ofteft 
liolds in the scliools. But even more import.int, improv isations, by their 
very nature, stress tlie interests of thestudentsand they stress action. The 
students create, plan, and sometimes perform improvisations. They 
produce, direct, tmd make costumes and background music for 
videotape productions of their improvisations. They write about their 
improvisations, talk about them, argue and laqgli about them. They 
read about the themes and conflicts which have formed the central con- 
flicts in theii impiov isations. In short, because of improvisations, they 
do thin^ .vith language, instead of only studying about English, they 
language about it. They use English to understand themselves, their 
world, and their place in it. They use English to shaie themselves vvith 
their classmates, and, through the reading they take part, emotionally 
and intellectually, in man's greatness, his pettiness,'his sorrow and his 
joy. 

I think that diere is little question that such an approach isdiffeient 
from the traditional approach, and that, vvhile it may not produce what 
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wegciicially coiimUu iiiaa»> uitic^, it probably will gciiciatc J>tudciii6 
who have some understanding of their own worth as human beings, 
who have self-confidence in their ability tospeakand write, and who en 
joy reading. 

State University College 
Fredonia 
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I often think qf Emily, 
who knew true uses of sound 
and never went gathering chatter 
on an endless round of calls/ 
a matter for modern comment. 
I myself can see her b«iking pies 
or brightening the wash 
accompanied by buzzing flies, 
but a woman's avoiding hairdressers 
suggests a quirk or even worse. 
(Only confessors dare dogmatize.) 
My theory is a fabulous Turk, 
unknown so far to American Lit, 
crept in at night and undid 
her hair in tresses of dark beauty 
she stroked in lonely pride, 
then bid him do his duty 
and pin it back in a bun so staid 
her own sister made no note 
she'd ever been undone. 

Fort Collins, Colorado 
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MEDIA REVIEW 



I Uv I.ilc .iiul I iiiUNol Jmli;*^ IU.iik b\ .SvN.nik MoUimi Puuiics. Im.. 

IZOi Jdlciviii A\i,. Su I.uuis. Missoisiu G3Iti(> KiiiiniiiK nnu l-O iniiunrs. Riiu.iL 

si*r>m (PC.). CoUh 

A man h.is iwu Ioncs in Ins life— an iniaUainablc goddess and a rnorial woman " So 
Mali's Judge Ro\ B(aii ni thiMuli inetaiigi of laiufiniiMi.hni Moi>. "JlM^of Jiimoin . saiiu 
lUan. a man liki RiMistAili miiIuI li* du uniu> ami du l.iiul. .ipinais in inaii> uiles h( is 
iuol> omiagontN as du Jiulgi dn ti>\MH>f \ inegaiiAHi ( Sungtif a I^jranuila'sTail") 
aiid<aMiall> ehnniiaK^ o[>in>s»Uoii bu\M<.ii liand«»uf a laidgaint.. assiiiul4)f du KXUUid( 
ol InsaiUoiis iKiansi Ins noiMnig au|naunami widi Pialiur>8. I lu liglnnnisuill le 
juuewlien iK Mcsdu \uigianii. ^ ci. Iikt M^ini lau OonQinMMtiif du ramous\\\^i. he 
lanfidUm m qm^M a dnani uf du ukal \M«nan. Mlss LiK LangU> Widigcnile. bidied 
gaHanu>f lie wiius iu lui a moment hefua duidi, ^ out piesencc ini du eanh hasgivcn 
nu Mrmgdi aiul digniivuWKiiMut miU*ag(.m!uiiaii.CMHl \n illmgl iiiiglaMjnudiiu bland 
nt \oiii liglii. Ill ap|>eai.saN da luinaniK MiisiliK ui iIk "posiUNiK UDpual" InaiU) of 
Ills land, andasilu aging man i\ho sti> Ins ilieanM|mul> i>Iipping aua> and ^ear^>/'IV•o 
fdi ivim t kniMv what n U>ok lolniilddns place, duN wuiii kno\N alKMil mt. . .Man isinor 
lal. l-iiiallv. lie is du iinigli-(.asi Od\AstUs i\lio rcUiins (o iiil ihi {own of du pervasive 
detav dial spread ilming Ins abseiui.. Iiki. a mvdiK hen* mU of auiiic old pituire lK)ok. 
hgluing a leaimg Iujim ami i.i>mg, l or I cNas and Miss Lilvl he achieves his final 
defmnion as Jnsui-C ' in die apocalyptic explosion that purifies the town. 

I lie auum anddialogiK i xi itid Innh nun-Rcgcnti and R(geiitsMudenii». and tin film 
lent used a vaiiet> ol tlumatu appioarhcs. the lu roas rebel. lo\t as real and ideal, die 
AmeiKaii Oriam and tts nituiiatc milcntiftcatii'ii \Mtli llK land, the op|K)sition of 
vTiigeaiice and jiistue. It is.m ubv umis iooiikc fiM unns(,s in rheO)\vbo> and American 
Ihimor. loiitaniing smh folk tvpes as tlu iHii^inal Bad Hub. the Albino, .uiil (iriz/lv 
AiUms who lohabiKd \Mtli the be.ns. I ligld> reioinnieiuled for Senioi I figh School 
Pubticn) .uul free biilleiiii Ixuid iM)sters available front Swank. 



Oveituie Nvitaii>. Running tmu. 9 minutes. RmtaL 512,50. Distribmed b> Coiiieni 
p(}iaiv Mt(r[a\\ IldU Pinucton Ro.id. Ilightowii, Ne\^ York 08520. Odor. 

Overturev Nyitan> is a sujjerb him for creative writing. Using special technjnucs, it 
reve.ils the development of .m enibr>o from the firsi cellular stirrings to the final 
emergence of a chicken from an egg. The processes of grow tliare recorded against a splen 
did b.ickgroimd of souiiil .md color, and the cl.issica! music provides an .iniazingly ac 
curate acconipaiiihieni to the events, 

I he film IS a riih lesuuui foi |>oiiiy .md dcsciiptt\( \n ruiiig .issignments. h pro\ ides 
.m eMelleiii \ isiial i N.uiipb oi tilt idea of the micnxosin andean be use<I lo explain die 
diUneni tvpes id iiarraii>ts m fiiuoii. It is .ilsi* highl> .suH.tbIc for courses inSiieiueFic 
tioii, espe(iall> in umniition iMtli du thiinc of faiilablii \u>.iges and the arclieiypal 
p.uiein of die journey 

H igh I V ie<()nHiiended foi .dl levels. 



* Hct\^een I imeaiid I iiiibukiu. Running nmi.9mmu(i,s. Rmial.STj.OO. nisirihutedby 
New LaneCaiieiiia. Lilmational I dm Division. 121 Univei,sit> Pl.itc, New York. New 
York 10003. 
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Sn.iiiiU <»f C^ii N (.i.nlt(. Uchoiiu Ui thv Mt)tilvc\ liousr.** "Sih-iin o{ I'liiiii." 
Ilai>|)\ Uinlul.i\ U.iiul.i JuiH .iiul S|.l»^^llUl-l loux \ .in wovrii iiiU) (his 
loiiipoMir I Ik tiliii > piot.ijL;i»m>i Sunn Su m u >u!un of Iii<Ii.iii.i|H)1is 
.iiiii uiiiiirt ol iIk lU.iNi'OII S|».u* ItMulJiUHh (,uiiu M. hiN ituiiiu \ ihiuui;h Jlu Chioiio 
S\iu l.iMK IiiUiiiiiibiiiiitii .iiul. M v.iiMMiN.tiitl tiii.iiiiitiUiuuhmK >, b.u k iouiiilu |)U)\idf> 
ilirli.iiiu'woik iIk i;laiit mi; \ oliln^tU \ ti\\ u! mh k i\ *>»oii\\<|ik>i fur 

thr iiir.iiHiii.^i)( iiU aiul d« .lUn liui.iM n iti.tii LtUn.il Stiu i<l< I'uilui wluii .iui>loiiici wlm 
ilinppni iiunniiin»U jNkv WiMt.tH jxoplt l»ii..iinu.i\ \<>i Mirpi ism,i«|\ . tin ii 
i> no aii>u<'i in old ni.Mi n l.i>t (|iu'>iioii. 

I tu tilin i> tiNHiii loi cl.i»iMH viiin aiul Mium ta ii.>ji.,iikH«>i iiiiii>« ii iin iholoi;^. 
ahliri\|Ml pauriii>. loim iiipoian uiittiiaiul \ahn> K<ct»miiiun!uMt»i lli^li SdiouL 

I.. KlIlMMl 



Oiraiii ol \\ titi llniM> Klilllllll^ iniit 'niiiiitiic>. KuimI SIJ/»0 Di^Milniiul b\ (von 
irinpoian M((»ia\v llill. I'liimloii Koad. \cu ^oikOK'j^O 

I liiMcniaikaMi lilni iakt_> aMl> >ub)u mIh uiMIioIm >oI < ^iinai<im \ \n iArol>lou 
motion and Noli-l«Mn> bai k^iuuiul> tnin dn <\uit>of i\n lilni iiU<» >cuu><il iianniint; 
lMaui\ Um aujhciHt i> almiibui f»\ i!u lik ol du Ik id— >ia!luHi> biiualh figliHoi 
\ domiiiaiKf. tiK huii gallops dllou^b iH<an iinM »n i\n <ail\ dawn. dK anniial> lait 
diiouubhii \i i»iK>.dK hliniiiakt>u>s<t i!k buda>mail\ a pnu ab>na< (um of ih\ dun 

and nuHnntni j 

t 

IbiN tdni. an \\\aid ol M<iii uninu ai du l^HA) I dudjuiH I dm I oiixal. is a iicli 
\ >oiiii( loi MU4lciit> ol ucan\( untni^ ol all nai t>— >pu lal. noii i<,i;<n(>. n'gcni>. ad 
\ani<d ltaiM>Und> iim II ut il U) unii> on du \U>i llii;hl\ moiiiiiu ndid foi all lorls. 

Kdi><)ii 



\ 



IHa/i (.Ion Rniinin^ unit 12 mMiiiU >. Ki iHal S\ji\i) DiMiibnutl b> du NalKin^il 
hdiuanon i din (.rnicL Konu 2. i Mnksbln^. Mai \ laiuPilOIS. (x»loi, 

I biNsp«M»l on iIk wian I \ ur>uin i> lx»di tn>ntu aiKlbii;hl\ i nhiiainnii;. I'br 
fdol. ov< i«pai k» d w nil dn t\ pu.d t U nn nts of du uisn in. moMMpiK klv *'i'oni;b a v iks 
olr\*iHN\\buhpio\Kh. Willi dii lulpol >pn laUlf* i h.aiiaiinnaU <l d( fiiiinoiiof pan)d\ 
IIk' Idni N ptoMiiaiion ol du i4j\\bo\-bno ni d^ iidKidiMixliaKKUi ol lUa/(-(>Ioi\ 
<|unkl\ cluiiN diMii»K»n ot om i \pi t »ahoii> ol du Ik lo ni iIk naiiinonal wcsirin flii k 

fii addition u> usob\ ions nv iii a uini un >atnit . n * oubl abo w< 11 In nIuiw n m units 
on lUv brio, tin lit< laiiiu of ilu \inriKaii Wot, and. of cduim'. ni bnmoi. 

|. I nt»luiv. 
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